Motion Capture with Sensor Data from Phone, Watch, Earbuds

May 12, 2023 | Reality
Future Interfaces Group

Researchers with the Future Interfaces Group at Carnegie Mellon have developed a way to fairly accurately track body movements in real time, using only a smartphone, smart watch and earbuds.

Called IMUPoser, this system takes inertial measurement unit data from the devices, providing a way to cheaply guess what the body is doing. It can work with all three devices (phone, watch and earbuds), down to just 1, using it’s algorithm to make a best guess on what’s happening.

This could prove a cheap and easily accessible way for users to track their bodies with technology most people already have.