
Augmented reality (AR) may improve the performance of ultrasound image guidance, say researchers from Canada who developed a new technique using AR and ultrasound to help pilot needle insertion into the spine. They discuss their method in an article recently published in Ultrasound in Medicine and Biology.
The group developed a novel method using a combination of AR and ultrasound to guide epidural injections, the most common intervention in pain management of the spine (Ultrasound Med Biol, July 4, 2019).
Clinicians typically perform epidural injections by relying on anatomic landmarks to guide needle insertion, a blind technique that suffers from a low first-pass success rate, noted first author Golafsoun Ameri, PhD, from the Robarts Research Institute, and colleagues. Recently, various groups have attempted to use imaging modalities such as ultrasound to improve needle navigation and placement, but the visualization provided by 2D imaging is limited in depth and clarity.
"Despite promising results, real-time ultrasound guidance for needle navigation and placement in the epidural space remains challenging and has not been adopted for everyday practice ... largely because of poor needle visibility ... and poor target visibility," they wrote.
To address these challenges, Ameri and colleagues integrated AR technology into ultrasound image guidance using proprietary software that they developed on two open-source software platforms (3D Slicer; Public Library for UltraSound). The software enabled them to overlay virtual 3D models, or AR models, onto a display showing ultrasound images in real-time.
After calibrating the ultrasound probe, the researchers had four clinicians test the viability of their combined AR and ultrasound image guidance technique in a series of trials. For the trials, the clinicians used either AR with ultrasound or ultrasound alone to guide needle insertion into a 3D-printed spine model that they had previously created based on patient CT scans.
The researchers found that all seven of the AR-guided procedures were successful, whereas nearly half of the attempts using only ultrasound guidance resulted in accidental punctures of the dura mater of the spinal cord. What's more, the AR-guided method took a shorter amount of time, required less effort, and was associated with a lower level of subjective "frustration" than ultrasound guidance, according to the clinicians.
| Effectiveness of AR + ultrasound vs. ultrasound alone for spine needle insertion | ||
| Ultrasound guidance | AR + ultrasound guidance | |
| Rate for accurate needle insertion | 57% | 100% |
| Procedure time | ~58 seconds | ~34 seconds |
Though only a small-scale evaluation, the study's findings demonstrate the potential of AR plus ultrasound image guidance to improve needle placement on several fronts -- from making the task seem more intuitive to reducing procedural time and intraoperative complications, the authors noted.
"The AR ultrasound image guidance system was implemented on an open-source platform with the aim of fostering research collaboration and accelerating the improvement of state-of-the-art guidance systems for overcoming challenges in not only epidural injections but also other common needle interventions to achieve improved patient outcomes," Ameri and colleagues wrote.
In addition, the AR technique includes recording and playback functionalities that allow for the technique's use in skill assessment and training, they wrote. These features may promote the technology's eventual adoption in day-to-day clinical practice for a wide variety of clinical procedures, such as biopsy, brachytherapy, and minimally invasive cardiac procedures.













![Examples of ultrasound findings and techniques. (A) Images in a 39-year-old male patient with a mass in the left thigh. The mass is heterogeneous on the B-mode US image (compared with the patient in D) and showed increased microvascularity (superb microvascular imaging [SMI]) and shear-wave elastography (SWE) values. Undifferentiated pleomorphic sarcoma was diagnosed at biopsy (with pleomorphic rhabdomyosarcoma in surgical specimen). (B) Images in an 18-year-old male patient with a mass in the left leg. The mass is hypoechoic on the B-mode image, with no other findings suggestive of malignancy. The lesion is in contact with the cortex of the tibia, which is slightly irregular. CT revealed a doubtful anteromedial tibial erosion. The microvascular study demonstrated high vascularization, suggestive of malignancy. Periosteal Ewing sarcoma was diagnosed with both histologic and immunohistochemical confirmation. (C) Images in a 69-year-old female patient with a lump growing on the outside of the left leg. Multiple SWE examinations were performed (please note the high values obtained in the measurements, whereas the color map highlights the stiffness relative to adjacent tissues). SMI showed areas of increased vascularization to target for sampling. Undifferentiated spindle cell sarcoma was diagnosed at biopsy, with residual leiomyosarcoma in the surgical specimen after neoadjuvant therapy. (D) Images in a 56-year-old female patient with a mass in the right thigh. The mass is heterogeneous at both B-mode ultrasound (similar to patient A) and MRI (coronal T2-weighted spectral attenuated inversion recovery [SPAIR]; T1-weighted pre-contrast and postcontrast imaging), which even shows uptake after the administration of paramagnetic contrast material, which is traditionally suggestive of malignancy. Low values at SMI and elastography are suggestive of benignity. Spindle cell lipoma was diagnosed at biopsy, with atypical spindle cell lipomatous tumor in the surgical specimen.](https://img.auntminnie.com/mindful/smg/workspaces/default/uploads/2026/08/images-radiol250278fig2.APCFLSvX6p.jpg?auto=format%2Ccompress&fit=crop&h=112&q=70&w=112)



