MIT's New AR System Enhances Interpretation of Ultrasound Images

Researchers at the Massachusetts Institute of Technology (MIT) have developed an innovative ultrasound imaging system that utilizes augmented reality (AR) to provide real-time 3D visualization of scanned objects. This technology could potentially transform ultrasound interpretation by simplifying the traditionally complex process of mentally reconstructing 2D images into a comprehensible 3D format.

The MIT system incorporates a virtual-reality headset to project a precise 3D digital representation of the subject, assisting users in identifying and analyzing the scanned object with greater ease. This approach holds promise for training ultrasound technicians and other health care providers by reducing the cognitive burden associated with traditional 2D ultrasound imaging. Additionally, the system could aid in clinical procedures, such as accurately positioning a needle for biopsies.

In a study published in Nature Communications Engineering, MIT's team, led by associate professor Canan Dagdeviren, tested the AR-based system, called AR-VIU, on 18 participants, including ultrasound experts and novices. The system's introduction significantly improved the ability of all users, particularly novices, to accurately identify and locate objects within ultrasound-scanned areas. Participants performed tasks that involved identifying objects within a gel-like material designed to mimic human tissue, simulating practical scenarios such as locating needle insertion points.

This novel ultrasound system uses a custom-developed, real-time 3D ultrasound system specifically aimed at breast cancer detection. The ultrasound probe designed by the MIT team employs fewer elements than conventional systems, making it more cost-effective and energy-efficient. A chirped data acquisition system (cDAQ) aids in transmitting data, which is then rendered into a 3D model by the Unreal Engine, providing a comprehensive visual representation accessible through AR/VR headsets.

The feedback from users varied, with novice users favorably receiving the AR-VIU approach for its reduced complexity and enhanced intuitiveness. While some expert users preferred conventional methods due to familiarity, they acknowledged that the AR-VIU system could significantly enhance specific procedures, such as needle placement for biopsies and cardiac movement visualization during echocardiography.

Future research by the MIT team intends to refine the imaging resolution and validate further the AR-VIU system's accuracy. This development is supported by funding from the MIT Media Lab Consortium, the National Science Foundation (NSF), and other fellowship programs.