Multitouch imaging displays, Wii remote show promise in PACS

Despite software advances and widespread availability of advanced visualization technology, workstation hardware has not significantly changed since the introduction of PACS. However, new input devices, such as multitouch displays and Nintendo's Wii remote control, may be better suited for today's image viewing requirements than the traditional mouse and keyboard, according to research from the University of Maryland School of Medicine in Baltimore.

"Our initial work suggests that unique multitouch input devices and a common gaming remote tool may provide significant advantages in 3D interpretation and merit continued investigation," said Dr. Rishi Seth. He presented the study team's research during a session at the Society for Imaging Informatics in Medicine (SIIM) annual meeting in Charlotte in June.

Thanks to the success of the Apple iPhone, there has been a lot of interest in multitouch concepts and platforms, which allow users to control software applications with physical inputs or gestures, Seth said. Large multitouch workstations have also been developed, such as CNN's Magic Wall.

In radiology, the large number of complex imaging studies is increasing demands on radiologists, Seth said.

"Multitouch screens have the unique capability to sense multiple inputs simultaneously, allowing for multiple degrees of freedom and rapid response for image retrieval, display, and navigation," he said.

Using multitouch workstations, images can be rapidly sorted, zoomed, panned, and rotated, as well as efficiently compared with previous studies using different gestures, he said. The technology can also assist in organizing large amounts of information, potentially improving workflow and reporting.

To test the technology's potential in radiology, the researchers evaluated the DiamondTouch prototype multitouch display table (Mitsubishi Electric Research Laboratories, Cambridge, MA) using PACS software from TeraRecon of San Mateo, CA. The researchers observed the display's ability to navigate multiple imaging modalities, as well as its integration with existing PACS workstation and advanced visualization software.

The display offered a number of advantages, including the potential for improving workflow and productivity; the integration of gestures for task operations, allowing for faster radiologist workflow; the potential for integration of symbol-based reporting; multiple degrees of freedom for improved navigation and manipulation; a large workspace for easier comparison with prior imaging studies; and multiuser capabilities for improved resident teaching opportunities, Seth said.

However, it also suffered from some limitations, including challenges in integrating the display with PACS, learning curves in working on a multitouch system (including the absence of a keyboard and mouse), ergonomic issues, artifacts such as shadowing, and difficulty integrating with dictation and electronic medical record (EMR) software.

The Maryland researchers also explored the use of the Nintendo Wiimote control in radiology applications, finding that the popular game control enables the user to manipulate 3D imaging in an intuitive manner not possible with traditional mouse and keyboard devices, according to Seth.

The Wiimote offers advantages such as intuitive navigation in 3D, low cost, an ergonomic design, an established role in the gaming community, and continual gaming research with the development of new applications and functions such as Wii MotionPlus. Its functionality is also easy to translate to radiology, he said.

Limitations include extremely sensitive manipulation, the possibility of too much sensitivity for certain applications, requirement of an initial training period, and its challenge to the status quo, Seth said.

As multitouch devices become more prominent in consumer products, their functionality continues to seem more promising, if not inevitable, Seth said.

Novel input devices challenge the paradigms of traditional digital interpretation and image manipulation, allowing for improved intuitive management of 3D datasets and advanced imaging, Seth said.

"We were successfully able to integrate two developing, novel input devices into an established PACS system for advanced image manipulation," he said.

The Maryland researchers noted several current goals and challenges for these novel input devices, including developing tighter integration with PACS workstations, advanced visualization systems, and EMR software. They would also like to evaluate the effects of this integration on workflow, and develop an optimal ergonomic solution for utilizing this technology, Seth said.

The study team also hopes to evaluate and reduce artifacts from fingerprints and shadowing, as well as improve sensitivity, he said.

By Erik L. Ridley
AuntMinnie.com staff writer
July 6, 2009

Related Reading

Handheld devices show promise for patient education, June 8, 2009

Treadmill-based workstation gets radiologists moving, June 6, 2009

Ergonomic practices can decrease repetitive stress injuries, May 18, 2009

Wii remote, Baroque music can lighten the load in reading rooms, April 28, 2009

PDAs may be suitable for viewing trauma head CT, January 25, 2008

Copyright © 2009 AuntMinnie.com

Page 1 of 775
Next Page