Researchers were able to get it to follow text commands to play seven different games and move around in three different 3D research environments. They trained it on lots of examples of humans playing video games, alongside keyboard and mouse input and annotations of what the players did. Then they used an AI technique called imitation learning to teach the agent to play games as humans would.