A Reddit consumer lately pit the chess engine Stockfish, which has received the Prime Chess Engine Championship eight instances, in opposition to the infamous AI-powered dialog bot ChatGPT in a dismal chess match. Whereas Stockfish, because it has been created to do, was in a position to maintain its personal, ChatGPT sadly succumbed to chess’ high-stakes setting and went on a dishonest spree earlier than shedding.
Or, extra precisely, as authentic Reddit poster u/megamaz_ explains in a thread, ChatGPT bought swept up by its naivete.
“It merely doesn’t have sufficient context on the sport of chess to have the ability to know the state of the board and perceive the strikes it’s making,” megamaz_ stated. “In different phrases, it doesn’t know how one can play.”
That is excusable since ChatGPT, a language mannequin skilled and distributed by OpenAI, wasn’t born to play chess. It was, extra broadly, constructed to reply requests and reply to questions.
Although it’s develop into a preferred instance of how synthetic intelligence may quickly be used to open up our skulls and eat our brains, ChatGPT is much more ridiculously fallible than a human in some contexts. Even OpenAI admits on its web site that ChatGPT “typically writes plausible-sounding however incorrect or nonsensical solutions,” affords “usually excessively verbose and overuses sure phrases, reminiscent of restating that it’s a language mannequin skilled by OpenAI,” and “will typically reply to dangerous directions or exhibit biased habits.” It by no means claimed to be good. It doesn’t know every little thing. So when megamaz_ invited it to a sport of chess, it needed to get inventive.
“Should you see items seem out of nowhere, that’s as a result of that’s actually what ChatGPT stated it will play,” megamaz_ stated.
“Are you certain you wanna do this?,” megamaz_ requested ChatGPT at one level throughout their sport. “Rg8 captures your individual king.”
“Oops, it seems to be like I made a mistake,” ChatGPT replied humbly. “My apologies!” Nicely, not less than it’s not a sore loser.