Demonstrating Controller-Free Mixed Reality X-Ray Machine Training

초록

We demonstrate a controller-free, Mixed Reality training system that enables hands-on X-ray machine operation through natural hand interaction. The system addresses key limitations of conventional medical device training, including restricted physical access, high equipment costs, and radiation exposure risks. By leveraging optical hand tracking on a standalone head-mounted display, users can interact with a virtual X-ray machine using gestures that closely resemble real-world operation. A central component of the demo is a Virtual Tablet interface, which provides video-based operational guidance and allows users to seamlessly select and execute training scenarios for different patient postures. All interactions - including device manipulation and user interface navigation - are performed entirely through hand tracking, enabling immediate, walk-up use without controllers or calibration overhead. The system is designed specifically for live demo settings, allowing first-time users to experience realistic medical device operation within minutes. Informal user feedback from nursing students and clinical professionals indicates high engagement, strong perceived realism, and clear potential for scalable deployment in medical education and clinical training environments. © 2026 IEEE.

키워드