The companies research division recently released a paper which extends ChatGPTs capabilities to robotic arms, drones, and robotic home assistants, allowing people to interact with them using natural conversation.
“Our technical paper describes a series of design principles that can be used to guide language models towards solving robotics tasks. These include, and are not limited to, special prompting structures, high-level APIs, and human feedback via text. We believe that our work is just the start of a shift in how we develop robotics systems, and we hope to inspire other researchers to jump into this exciting field.”
Check out Microsoft’s article for more in-depth explanations and many example videos showing the system in action.