Xbox’s New AI Tool, Copilot For Gaming, Will Coach Players On How To Improve Their Gameplay

Xbox is introducing Microsoft’s generative AI, Copilot for Gaming, which will observe players’ gaming and offer assistance and advice on how to improve. 

On a recent episode of The Official Xbox Podcast, Xbox Corporate Vice President of Gaming AI, Fatima Kardar, introduced the new Copilot for Gaming feature, which is coming soon. According to the Xbox Wire announcement, this generative gaming AI is meant to help players “Save time, find new games you’re likely to love, or even to help ease you back into a game you may have stepped away from.” 

Think of Copilot for Gaming as a coach: it observes and keeps track of your progress, suggests ways you can improve your gaming skills and will be there to give advice if you find yourself stuck mid-game. This tool can especially be helpful when picking up a new game or trying to improve your skills and techniques in eSports. When sharing how the use of AI can benefit the world of gaming, Kardar points out that “Gaming is the only form of entertainment where you can get stuck, so that’s where you want something to show up to say ‘let’s help you get past that.’” Of course, you can toggle Copilot off as desired if you really don’t want it.

In one visual example of what Copilot for Gaming is projected to look like, the AI helps a player redownload Age of Empires IV and then asks if they would like a recap of where they were last time they played. The recap was quite detailed and offered a great example of how Copilot for Gaming will be able to keep track of players’ progress. 

Another basic example of how this AI can be helpful was in a clip of a new Minecraft player who asked Copilot what to do with wood logs and the AI then instructed them on how to create wood planks. To further illustrate the full capacity of this AI feature, Kardar later showed videos of Overwatch 2 gameplay where a player was communicating with Copilot in real time to receive feedback on the match and their personal gameplay.  

Because Copilot for Gaming is a generative AI, one topic of interest is where Copilot will be sourcing its information from and how accurate it will be. Kardar explained that Xbox has been partnering with game studios to ensure information accuracy, and they also aim to involve knowledgeable content creators. “We want to partner with [players],” she said, “and make sure that if they’ve put in the work, they should be able to benefit from that as well.”

Copilot for Gaming will be available soon in its beta stage through the Xbox Insider Program. Copilot will first be available on mobile only before slowly expanding to larger devices. The purpose of this beta launch is to get feedback from players early on since player interaction is the reason this AI was developed. Kardar said that when bringing AI to gaming, Xbox must proceed with caution. “We really for sure do not want to mess up the gaming experience… We put things out there, we let people give us feedback, try it out, see what resonates and build from that.”