The new Bing GPT-4 chat mode can write Xbox gaming guides, but it’s not perfect
Robot Wars
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
The newBing’s GPT-4 Chat mode has shown its potential as an Xbox gaming guides writer, but it looks like there’s a long way to go before it rivals actual human writers.
While it’s currently unknown whether the new Bing AI chat mode will be coming toXbox Series X, the software is now available in preview to those who sign up for a waiting list. According to Xbox Wire Editor Mike Nelson, it: “knows a hell of a lot about video games”. This has been tested in a way that depicts both the potential and some problems that could arise when an ever-learning algorithm tackles specific gaming knowledge.
Detailed in thefull press release, Bing sites where it’s getting the information from to try and answer what queries you’ve got about some of thebest Xbox Series X games. One particular example involved asking the new GPT-4 AI chat mode to give them a detailed recap of what happens in the first 20 hours ofThe Witcher3: Wild Hunt,which was pulled from ten different publications, including our sister site PC Gamer and variousYouTubesources.
While the information presented was accurate to the first half or so of CD Projekt Red’s opus, the sheer breadth of sources, including those from YouTube itself, asks exactly how thorough will the Bing AI be in vetting what’s given.
Not all guides online are created equal, and information on ideal strategies in-game can vary so widely. So, pooling from an array of sources varying in credibility isn’t always going to guarantee an accurate answer.
What’s the right answer again?
My concerns extend to the accuracy presented in the Bing AI GPT-4 chat mode’sOverwatch 2question. The test message asks: “What is the bestOverwatch 2character for me?” To this question, the artificial intelligence responds that there’s a total of 33 characters to choose from in the game with Damage, Tank, and Support classes.
Unfortunately, at the time of writing, there are, in fact, 36 total characters playable in the game, meaning the information that’s being pulled through is outdated.Rammatrais the newest character and was added back in December in Season 2, meaning the AI is around three months behind.
Get the best Black Friday deals direct to your inbox, plus news, reviews, and more.
Sign up to be the first to know about unmissable Black Friday deals on top tech, plus get all your favorite TechRadar content.
Of the 10 sources cited, it seems that the GPT-4 has struggled to discern what’s the most up-to-date answer as it provides a vague answer of: “you might want to take a quiz that matches your personality and preferences with the characters” instead of offering up viable options based on the current meta. Bing was able to produce something which sounded fine on the surface but didn’t really answer the question in a meaningful way. It liked Echo, the AI character, but explained nothing about the playstyle or quirks of the character outside of that.
This appears to be the biggest issue with asking Bing gaming questions and hoping for accuracy. Seeing that YouTube has been cited as a credible source multiple times, what’s stopping people from deliberately spreading misinformation on a subject and then having that adapted into copy from the AI?
It also raises questions regarding how GPT-4 directly cites existing websites and the extent to which what’s being said in the original material is adapted. Writers aren’t getting the credit they deserve, and the information attached to their names and publications may not fully reflect the original intention.
Aleksha McLoughlin is an experienced hardware writer. She was previously the Hardware Editor for TechRadar Gaming until September 2023. During this time, she looked after buying guides and wrote hardware reviews, news, and features. She has also contributed hardware content to the likes of PC Gamer, Trusted Reviews, Dexerto, Expert Reviews, and Android Central. When she isn’t working, you’ll often find her in mosh pits at metal gigs and festivals or listening to whatever new black and death metal has debuted that week.
Black Friday Xbox deals 2024: early offerings are beginning to appear at retailers
Where to buy the new Xbox Series X and S consoles - including the gorgeous Galaxy Black 2TB machine
I’ve used Genmoji and now I’m convinced Apple Intelligence will be a huge success
