Despite all its advances, ChatGPT still, seemingly, is less smart than an Atari simulator on beginner mode.
    • @TheAgeOfSuperboredom@lemmy.caEnglish
      39•4 days ago

      Its because of all the people saying that LLMs can reason and think and the human brain works just like an LLM and… some other ridiculous claim.

      This shows some limitations on LLMs.

    • @A7thStone@lemmy.worldEnglish
      15•4 days ago

      Why are so many people mad when it’s pointed out that the shitty chatbots are just shitty chatbots.

    • dantheclammanOPEnglish
      11•4 days ago

      I knew there would be these kinds of comments making this obvious point. This is just a demo of how these language models are not going to achieve the “General” part of AGI. It’s going to take a new paradigm

    • @EvilBit@lemmy.worldEnglish
      10•4 days ago

      Now apply this to like, everything else ever.

      Machine designed to convincingly fake human internet conversation sucks at ____________!

    • @BrianTheeBiscuiteer@lemmy.worldEnglish
      3•4 days ago

      Too many people forget that specialized, purpose-driven software is often if more effective and efficient. LLMs and other AI are nice when you don’t have a properly defined spec or a flexible algorithm but you pay, literally, for the convenience.

  • Chloé 🥕English
    16•4 days ago

    I think people in the replies acting fake surprised are missing the point.

    it is important news, because many people see LLMs as black boxes of superintelligence (almost as if that’s what they’re being marketed as!)

    you and i know that’s bullshit, but the students asking chatgpt to solve their math homework instead of using wolfram alpha doesn’t.

    so yes, it is important to demonstrate that this “artificial intelligence” is so much not an intelligence that it’s getting beaten by 1979 software on 1977 hardware

  • @flamingo_pinyata@sopuli.xyzEnglish
    16•4 days ago

    A chess-specific algorithm beat a language model at chess. Shocking!

    Try training a chess model. Actually I think it’s already been done, machines have been consistently better at chess than humans for a while now.

  • @Opinionhaver@feddit.ukEnglish
    5•4 days ago

    It’s AI, not AGI. LLM’s are good at generating language just like chess engines are good at chess. ChatGPT doesn’t have the capability to keep track of all the pieces on the board.

    • dantheclammanOPEnglish
      2•3 days ago

      They’re literally selling to credulous investors that AGI is around the corner, when this and to a lesser extent Large Action Models is the only viable product they’ve got. It’s just a demo of how far they are from their promises

      • @Opinionhaver@feddit.ukEnglish
        1•3 days ago

        Is there a link where I could see them making these claims myself? This is something I’ve only heard from AI critics, but never directly from the AI companies themselves. I wouldn’t be surprised if they did, but I’ve just never seen them say it outright.

    • @Pilferjinx@lemmy.worldEnglish
      1•3 days ago

      LLMs would be great as an interface to more specialized machine learning programs in a combined platform. We need AI to perform tasks humans aren’t capable of instead of replacing them.

  • acargitzEnglish
    3•3 days ago

    This is useful for dispelling the hype around ChatGPT and for demonstrating the limits of general purpose LLMs.

    But that’s about it. This is not a “win” for old school game engines vs new ones. Stockfish uses deep reinforcement learning and is one of the strongest chess engines in the world.

    EDIT: what would be actually interesting would be to see if GPT could be fine-tuned to play chess. Which is something many people have been doing: https://scholar.google.com/scholar?hl=en&q=finetune+gpt+chess