McGeorge, N., Latiff, S., Muller, C., Dong, L., Chewning, C., Friedson-Trujillo, D., and Kane, S.
International Symposium on Human Factors and Ergonomics in Health Care, HFES, 2021, Virtual Symposium.
Military and civilian medical personnel across all echelons of medical care play a critical role in evaluating, caring for, and treating casualties. Accurate medical documentation is critical to effective, coordinated care and patient outcomes. We will describe our prototype Context-Aware Procedure Support Tools and User Interfaces for Rapid and Effective Workflows (CAPTURE). Leveraging human factors and user-centered design methods, and advanced natural language processing (NLP) and computer vision capabilities, CAPTURE was designed to enable TCCC providers to more efficiently and effectively input critical medical information across a range of operational environments through hands-free interaction techniques and semi-automated data capture methods. We designed and prototyped a heads-up display that incorporates: multimodal interfaces, including augmented reality-based methods for input and information display to support visual image capture and heads-up information display; post-care documentation support (e.g., artifacts to support post-care documentation); context-aware active and passive data capture methods, specifically natural language processing using systemic functional grammars; and computer vision technologies for semi-automated data capture capabilities. During the course of this project we encountered challenges towards effective design which fall into three main categories: (1) challenges related to designing novel multimodal interfaces; (2) technical challenges related to software and hardware development to meet design needs; and (3) challenges as a result of domain characteristics and operational constraints. We will discuss how we addressed some of these challenges and lessons learned, as well as provide additional considerations necessary for future research regarding next generation technology design for medical documentation in the field.
To learn more or request a copy of a paper (if available), contact Nicolette McGeorge.
(Please include your name, address, organization, and the paper reference. Requests without this information will not be honored.)
