A Mixed Reality prototype built with Unity, running on Meta Quest 3. The Universal Robots UR10e industrial arm is imported from its official URDF data and placed into the user's real physical environment via passthrough, forming a foundation for maintenance training scenarios.
This project covers the first stage of building a Mixed Reality environment where maintenance procedures for an industrial robot arm can be simulated virtually. The UR10e's official URDF and mesh data were used to import the robot's full joint hierarchy (base, shoulder, elbow, wrist 1-2-3) directly into Unity, scaled to real-world dimensions and placed inside the user's own room.
- Unity 6 (Universal Render Pipeline)
- Meta XR SDK / OpenXR
- Meta Quest 3 (Mixed Reality Template)
- Unity Robotics Hub - URDF Importer
- Universal Robots ROS2 Description (official UR10e URDF and mesh data)
- XR Interaction Toolkit
- Passthrough-based Mixed Reality view
- UR10e robot imported with its real joint hierarchy
- Realistic materials and coloring (silver body, blue joint bands)
- Basic hand-tracking interaction
- Real-world scale robot placement
- Clone the repository
- Open the project in Unity 6 (or later)
- Make sure the Android Build Support module is installed
- Connect a Meta Quest 3 in Developer Mode via USB
- Select the Android platform under
File > Build Profilesand useBuild And Runto deploy to the device
- Set up Unity and Meta Quest 3 development environment
- Import the UR10e robot from its URDF
- Realistic materials and coloring
- Interactive joint manipulation by hand
- Design the maintenance scenario (step-by-step procedure)
- Automatic placement on a real table/surface (Scene API)
- Evaluation and feedback system
This project is intended for educational and prototyping purposes. Universal Robots URDF data is subject to its own license.