UMI-F/T
Wireless Force-Sensing Hardware Extension for the Universal Manipulation Interface
Making physical interaction measurable.
I designed and prototyped a wireless two-axis force-sensing hardware extension for the Universal Manipulation Interface (UMI), focusing on mechanical integration, fabrication, and preliminary functional verification.
- Mechanical Design
- Prototyping
- Force Sensing
Overview & Research Objective
Adding a sense
of force.
Accessible, low-cost demonstration collection tools are important for building the datasets used in robot learning. The original Universal Manipulation Interface, developed by Shuran Song’s research group, provides a practical platform for collecting visual observations and manipulation demonstrations.
Our team explored extending this platform with physical interaction measurements. My focus was a wireless module for measuring X–Y loads at the gripper’s wrist-mounting interface.
The objective was to support future synchronized vision-and-force data collection, force-aware robot learning, and contact-rich manipulation. In this project, our work focused on hardware development and preliminary functional verification.
Mechanical Design
From concept
to mechanism.
Designed around the interface.
The mechanical work centered on integrating a two-axis force-sensing extension at the UMI gripper’s wrist interface.
The CAD views illustrate the finger mechanism and handle/frame design.
Finger Mechanism
Handle & Structural Frame
Prototype Fabrication & Integration
From CAD
to hardware.
I fabricated the mechanical components using 3D printing, assembled the prototype, and integrated the sensing hardware into the mechanical structure.
Software development was handled by a Ph.D. researcher on the team.
A view from
the interface.
Fisheye observations show the UMI gripper in its open and closed states.
Two states, captured from the same viewpoint.
Prototype Demonstration
Seeing it
in action.
Mechanical Function Tests
Hands-on tests of the fabricated finger mechanism and handle button.
UMI Platform Demonstrations
From prototype
to platform.
The following videos show how the prototype was used within the broader UMI setup.
Robot-arm control software and robot-learning implementation were handled by a Ph.D. researcher on the team.
My Contribution
What I
contributed.
- Mechanical Design & Hardware Development
- Designed the wireless two-axis force-sensing hardware extension, including the gripper and wrist-mounting interface, with a focus on measuring X–Y loads.
- Prototype Fabrication & Integration
- Fabricated mechanical components using 3D printing, assembled the prototype, and integrated the sensing hardware into the mechanical structure.
- Preliminary Verification
- Tested the mechanical operation of the gripper fingers and handle button, and confirmed basic X–Y force-measurement functionality during initial hardware testing.
My contributions focused on mechanical design, prototype fabrication, and preliminary hardware verification.
Robot-arm control and robot-learning software were developed by another team member.
References
- Chi, C., Xu, Z., Pan, C., Cousineau, E., Burchfiel, B., Feng, S., Tedrake, R., & Song, S. (2024). Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots. Robotics: Science and Systems (RSS). DOI: 10.15607/RSS.2024.XX.045.
- Zhao, T. Z., Kumar, V., Levine, S., & Finn, C. (2023). Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware. ICML 2023 Workshops: Frontiers4LCD. arXiv:2304.13705.
- Kamijo, T., Beltran-Hernandez, C. C., & Hamaya, M. (2024). Learning Variable Compliance Control From a Few Demonstrations for Bimanual Robot with Haptic Feedback Teleoperation System. 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12663–12670. DOI: 10.1109/IROS58592.2024.10801731.