Motion Capture with Sensor Data from Phone, Watch, Earbuds

May 12, 2023 | Reality
Future Interfaces Group

Researchers with the Future Interfaces Group at Carnegie Mellon have developed a way to fairly accurately track body movements in real time, using only a smartphone, smart watch and earbuds.

Called IMUPoser, this system takes inertial measurement unit data from the devices, providing a way to cheaply guess what the body is doing. It can work with all three devices (phone, watch and earbuds), down to just 1, using it’s algorithm to make a best guess on what’s happening.

This could prove a cheap and easily accessible way for users to track their bodies with technology most people already have.

https://www.youtube.com/watch?v=hgpjbKv8XFY
https://github.com/FIGLAB/IMUPoser
https://www.figlab.com/research/2023/imuposer