The MedReality solution offers three visualization environments in which to view your patient specific model(s).  With applications for iOS devices, Microsoft HoloLens 2 and Oculus Quest you can use augmented reality on the iPhone, mixed reality in HoloLens 2, or completely immerse yourself in virtual reality on the Oculus.  Each selection offers different benefits that can help you decide which to use and when.

iOS augmented reality:  The ability to launch a viewing session of your model into the omnipresent smartphone or iOS tablet offers immediate access to anatomies to a huge number of people with minimal friction. The viewer on iOS devices blends the camera view with the rendering of the model, and the social nature of a smartphone in hand (versus a device on head) allows additional people to view the same model from different points of view, collaboratively. The graphics capabilities of the smaller devices like iPhone may limit the size and detail of the model, so triangle counts less than 500,000 are recommended.  Models are overlaid on the actual background, and seeing them in actual size or scaling them up for visibility, but with a person in the view for reference, can help balance understanding.

 

 

Microsoft HoloLens 2 mixed reality: For those with access to HoloLens 2, interacting with the models using natural hand-only gestures can really help facilitate understanding and ease manipulation in terms of rotating and scaling the model.  As a head-mounted computer, HoloLens 2 has restricted graphics capability compared to desktop systems, so model triangle counts of 250,000 or less are recommended.  Where there are multiple parts to the overall model (e.g., several bones comprising a joint that needs attention) moving them around is very easy in the HoloLens. For instance, you can bring in the scapula and humerus (remember to create them as separate files that then can be loaded into the same viewing session but manipulated individually) in anatomical relationship but “disarticulate” them to see the opposing faces. With HoloLens 2, it’s just a matter of pulling the models in separate directions.

 

 

Oculus Quest virtual reality:  With the power of advanced graphics, the Quest system allows for full detail model viewing in a completely immersive environment.  VR viewing is best done in a dedicated space that can be mapped out for safety and eliminates walls, furnishings or scenery that can distract from the anatomical model.  Lighting and shadowing is completely contained within the VR environment allowing models to retain the material and color properties assigned on creation.  The VR experience of manipulating the parts of a multicomponent model are not as immediately intuitive as the hands-only HL2, but with practice the controllers become second nature.  The key benefit of the VR application is the complete control of the distraction-free environment.

Interested in trying out MedReality?  Click here to get started