How Simtryx Enhanced UI/UX Design of Mixed Reality Medical Training with ShapesXR

Case Study: Simtryx

Simtryx, a XR studio focused on immersive healthcare simulations, integrated ShapesXR to enhance their design process. Using ShapesXR's prototyping tools and collaboration features, Simtryx improved their interface design workflow, ensuring accessibility and a robust user experience for the mixed reality training simulation. The tool facilitated remote team coordination and allowed efficient early testing and iteration of complex scenes in an MR environment without the involvement of developers.

Background and Objectives

Simtryx is a spatial computing startup developing the most accessible and immersive healthcare simulations for medical training in universities. 

Our simulation blends the most advanced hand-tracking implementation for all kinds of physical tests, video passthrough for quick onboarding, and fully AI-powered speech interaction with the simulated patient. 

Our team members are working globally, between the USA and Peru and we were looking for a tool that would allow us to redesign a more sophisticated interface without sacrificing accessibility, improve communication between the design and development team and test UX design more accurately before developing code for it.

“After experiencing the power of ShapesXR in designing our revamped user interface, it has become a staple in our workflow and a game-changer for us. Importing 3D models from our art team is seamless, and the collaboration tool encourages our remote team to work together naturally.” - Hector Mondragon, Co-Founder & CEO

Decision Process

We’ve been using Figma for our design work with user experience and interface, but the more we built onto our product, the more we felt the need to review our design in a VR space before approving for production. This is because we found that positioning the simulation patient, with all the poses needed for user interaction, would require careful consideration when dealing with our interface and mixed reality passthrough.

ShapesXR had a clear focus on prototyping for VR apps, as there was a robust interaction system for buttons. Also, the live collaboration & sharing options were significant, and the video passthrough worked reliably. This mix of features put it right on top of our list.

Implementation and Use

ShapesXR provided powerful & intuitive VR tools to let our artists and designers arrange the interactive 3D elements in a mixed reality space. Not only did it let them test out the scenario quickly in a VR space, but also the collaboration feature heightened our team’s ability to give feedback and work better together.

Our designer would first sketch out the scenario with basic shapes from ShapesXR to represent elements that would make up the scene. Then, after a meeting inside ShapesXR with our art team, our artists would import refined 3D elements inside the prototype scene and start placing them following the designer’s mockup.

We were also able to import complex 3D models of the patient in different poses and visualize the scale and position of the patient relative to our new menus and the mixed-reality environment.

No items found.

Results and Feedback

Through ShapesXR, we were able to go from our initial menu interface into our revamped and content-dense new menu. The prototyping and feedback of the new immersive menu was all done inside ShapesXR and our client shared great feedback highlighting how the new user experience is still accessible while including many more options than before.

Overall Experience

We were impressed by how easy it was to integrate ShapesXR into our current workflow.

The collaboration component works great for our remote development team and being able to design with video passthrough active is exactly what we needed for our product. 

ShapesXR has become our go-to tool for our design phase and UI development. For the dozens of scenarios that we’ll be working on in our development roadmap, ShapesXR will remain a key component in our workflow.