Augmented Reality Technology to Facilitate Proficiency in Emergency Medical Procedures

Laurel O’Connor1, Sepahrad Zamani1, Liam Porter2, Nicolette McGeorge3, Susan Latiff3, Timothy Boardman1, Matthew Loconte1, Michael Weiner1, Eileen McGarry1, Felipe Pina1, Jorge Acevedo Hermaan1, Andrew Milsten1, Martin Reznek1, John Broach1 In Proceedings of the 56th Hawaii International Conference on System Sciences. Hawaii. (January 2023) Background: Augmented reality (AR) conveys an experience during which the user’s real-time […]

Toward Intuitive Understanding of Complex Astrodynamics Using Distributed Augmented Reality

Advanced Maui Optical and Space Surveillance Technologies Conference (AMOS),  Maui, HI (September 2021) Stouch, D., Balasuriya, U., Hyland, R., Bird, L., Jenkins, M., and Kingsley, C. Existing capabilities and future possibilities can help multiple users build an intuitive understanding of complex astrodynamics in a collaborative real time virtual environment using an augmented reality (AR) space […]

Design and Development of a Prototype Heads-up Display that Supports Context-aware, Semi-automated, Hands-free Medical Documentation

McGeorge, N., Latiff, S., Muller, C., Dong, L., Chewning, C., Friedson-Trujillo, D., and Kane, S. International Symposium on Human Factors and Ergonomics in Health Care, HFES, 2021, Virtual Symposium. Military and civilian medical personnel across all echelons of medical care play a critical role in evaluating, caring for, and treating casualties. Accurate medical documentation is […]

A Pilot Study Comparing Two Naturalistic Gesture-Based Interaction Interfaces to Support VR-Based Public Health Laboratory Training

Voge, J., Flowers, B., Herrera, N., Duggan D., and Wollocko, A. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA (March 2020) Training opportunities for public health laboratories (PHLs) are limited, and traditional wet laboratory training is expensive and potentially hazardous. Virtual reality presents a promising complement to existing training and provides the […]

Enhancing Situational Awareness through Perceptual and Cognitive Acclimation to Augmented 360-Degree Visual Fields

News Article Icon

Kingsley, C., Wollocko, A., and Jenkins, M. Special Augment Event at Interservice/Industry Training, Simulation and Education Conference (I/ITSEC), Orlando, FL (to be presented in December 2019) Charles River Analytics is developing a system to enhance situational awareness (SA) by extending humans’ natural field of view (FOV), roughly 120°, to a real-world, 360° FOV. Our system provides a […]

A Human Factors Approach to Networked Virtual Reality and Augmented Reality Interactions with Physiologically-Driven Believable Agents

News Article Icon

Kingsley, C. and Jenkins, M. 2019 Applied Human Factors and Ergonomics (AHFE) International Conference, Washington, DC (July 2019) Charles River Analytics has been leading numerous research and development efforts within the Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) domains, collectively Extended Reality (XR), including an exploration of the human factors considerations for […]

An Extended Reality (XR) SDK to Foster Development of Realistic XR Simulations Through Naturalistic Control and Dynamic Virtual Environments

News Article Icon

Kingsley, C., Duggan, D., and Jenkins, M. 73rd Department of Defense Human Factors Engineering Technical Advisory Group Meeting (DoD HFE TAG), Aberdeen, MD (April 2019) Among the multitude of training techniques the DoD employs, virtual simulation continues to grow due to its ability to more closely emulate real-world contexts. However, these high-fidelity virtual simulations also often […]

Supporting a Rapidly Advancing Industry: Ensuring XR Utility and Usability Through Software Development, Human Factors Research, and Novel Applications

News Article Icon

Kingsley, C., Duggan, D., and Jenkins, M. 73rd Department of Defense Human Factors Engineering Technical Advisory Group Meeting (DoD HFE TAG), Aberdeen, MD (April 2019) While the extended reality (XR) industry – collectively augmented reality (AR), mixed reality (MR), and virtual reality – rapidly progresses, essentially reinventing the very definition of these terms with the introduction […]

A Toolkit to Help Integrate Humans with Virtual Environments, Intelligent Simulations (FSMs), and Artificial Cognitive Systems (NPCs)

News Article Icon

Kingsley, C. and Jenkins, M. Proceedings of the 2019 Intelligent Human Systems Integration (IHSI) International Conference, San Diego, CA (February 2019) Charles River Analytics is developing an open-source, Unity-based Extended Reality (XR) SDK for development of immersive simulations, currently focused on medical simulations. Our work-to-date has focused on integrating humans into virtual environments through enhanced […]

Applications of Virtual Environments in Human Factors Research and Practice

Spain, R.1, Goldberg, B.2, Khooshabeh, P.3, Krum, D.3, Biro, J.4, Linder, C.4, Stanley, L.4, Tredinnick, R.5, Ponto, K.5, Gisick, L.6,  Pierce, M.6, Keebler, J.6, Young, P.6, Hancock, A.7, Phillips, J.7, Steinhauser, N.8, Niehaus, J.9, and Flynn, J.10 Proceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting (November 2019) Virtual reality, augmented reality, and other […]

Mixed Reality Simulation of Emergent Roadway Technology for System Validation and Evaluation

Flowers, B.A., Bird, L., Negri, A., Duggan, D., and Jenkins, M. Presented at the 2nd Automated Driving Systems Conference & Expo, “How Revolutionary Might Shared and Autonomous Mobility Be: Some Insights from Recent Evidence,” Las Vegas, NV  (November 2019) Connected vehicle technology presents new opportunities to improve human safety and efficiency. However, it can be prohibitively difficult to […]

Spatial Degradation of Color Discrimination in Augmented Reality

News Article Icon

Flowers, B. A., Wollocko, A., Kingsley, C., Thiry, E., and Jenkins, M. 10th International Conference on Applied Human Factors and Ergonomics (AHFE 2019), Washington D.C. (July 2019) Stereoscopic Augmented Reality displays are known to degrade the color perception of users. Using a spatially-aware color matching task, we performed a repeated trial study in which participants […]

Exploring Extended Reality as a Simulation Training Tool Through Naturalistic Interactions and Enhanced Immersion

News Article Icon

Duggan, D.1, Kingsley, C.1, Mazzeo, M.2, and Jenkins, M.1 International Conference on Human-Computer Interaction: Virtual, Augmented and Mixed Reality Applications and Case Studies, Orlando, FL (June 2019) Augmented reality (AR), mixed reality (MR), and virtual reality (VR) technologies – collectively extended reality (XR) – have been discussed in the context of training applications since their […]

Characterizing the Limits of Visual Field Augmentation in Augmented Reality: Psychophysical Foundations for Design and Mode Transition Acclimation Strategies

News Article Icon

Jenkins, M., Kingsley, C., and Flowers, B.A. Panel Presentation at the 22nd Annual Applied Ergonomics Conference, New Orleans, LA (March 2019) The impact of augmented reality displays on the human perceptual system will vary across headsets. Because of this, the display used for any solution should be selected with an awareness of the interaction between the […]

Using Perspective to Reduce Stimulus Response in Virtual Reality

Flowers, B1., Tatoian, R2., Katenka, N2., and Herve2, J. 2018 IEEE Games, Entertainment, Media Conference (GEM) (August 2018). The method used to immerse a participant within Virtual Reality has an impact on the way in which the participant physiologically responds to environmental stimuli. Given a situation where a participant is expected to express a negative or […]

Using Multi-Sensor Voting for Resilience in VR Biofeedback Games

Flowers, B1., Tatoian, R2., Witkowski, A2., Katenka, N2., and Herve2, J. 2018 IEEE Games, Entertainment, Media Conference (GEM) (August 2018). Biofeedback games are often developed to teach self-management skills to children. Unfortunately, the underlying system for many of these games are designed for laboratory environments and are not built to accommodate sensor movement and noise […]

Development of Virtual Simulations for Medical Team Training: An Evaluation of Key Features

Howe, J.1, Puthumana, J.1, Hoffman, D.1, Kowalski, R.1, Weldon, D.1, Miller, K.1, Weyhrauch, P.2, Niehaus, J.2, Bauchwitz2, B., McDermott, A.2, and Ratwani, R.1 Poster presentation for the International Symposium on Human Factors and Ergonomics in Health Care, Boston, MA (March 2018) Teamwork is an important factor in reducing medical errors and increasing clinical efficiency. Medical […]

Increased Space Situational Awareness through Augmented Reality Enhanced Common Operating Pictures

Jenkins, M., Catto, G., and Bird, L. Presented at the Advanced Maui Optical and Space Surveillance Technologies Conference (AMOS), Wailea, HI (September 2018) Support for space situational awareness (SSA) is required to enable military commanders and space operations center operators to maintain an advantage over our adversaries in the space enterprise. Well-designed visualization and human-computer […]

Preliminary Evaluations of Wearable XR Viewing and Interaction Hardware for Prolonged Use in Military Settings

Jenkins, M. and Talbot, T. Invited panel presentation for the 2018 Human Factors and Ergonomics Society (HFES) Annual Meeting, Philadelphia, PA (October 2018). In recent years, wearable augmented, virtual, and mixed reality (XR) technologies have supported users in a variety of domains to enhance situation awareness (SA), enable on-the-job training, foster effective communications, and support […]

Design of a Multimodal Interface Solution to Facilitate Nonmedical User Mediation of TBI Screening Using Virtual Reality

Presented at the International Symposium on Human Factors and Ergonomics in Health Care, Boston, MA (March 2018). Vestibular dysfunction (VD) commonly accompanies traumatic brain injuries (TBI). Assessments of VD are currently only conducted in clinical settings by highly trained medical professionals (e.g., otolaryngologists). These professionals use either: (1) subjective assessments requiring specific expertise to expose […]

Helmet-Mounted Displays to Support Off-Axis Pilot Spatial Orientation

Kane, S. and Kilgore, R. In: Chen J., Fragomeni G. (eds) Virtual, Augmented and Mixed Reality: Applications in Health, Cultural Heritage, and Industry. VAMR 2018. Lecture Notes in Computer Science, vol 10910. Springer, Cham (June 2018). Aerial refueling is one of the most demanding and dangerous activities faced by pilots. To monitor refueling, pilots must […]

Preliminary Evaluations of Wearable XR Viewing and Interaction Hardware for Prolonged Use in Military Settings

Garrett, G1., Reid, C1., Jenkins, M2., Talbot, T3., and Doherty, S4. Proceedings of the Human Factors and Ergonomics Society Annual Meeting (September 2018).  Augmented or mixed reality devices overlay computer-generated sensory information that alters one’s current view of the real world. Gaming, military, and instructional applications are fairly prevalent, however, industrial applications are still in their […]

Virtual Patient Simulation with Objective Metrics for Primary and Secondary Trauma Assessment

Weyhrauch, P.1, Niehaus, J.1, Bauchwitz, B.1, Broach, J.2, Lancette, P.J.2,3, and Ritter, F.E.4 Presented at the Military Health System Research Symposium (MHSRS), Kissimmee FL (August 2017) Background One commonly used approach to training trauma assessment and other emergency medicine skills is simulation-based training, allowing trainees to practice their skills with simulated patient scenarios. This approach often […]

Developing a Rapid Prototyping Framework for Applications that Interface with Sensor Devices

Irvin, S., Palmon, N., Jenkins, M., Bracken, B., and Elkin-Frankston, S. Presented at the Global Health and Performance Summit, Columbus, OH (May 2016) Custom applications used to collect data from sensor devices like EEG, EMG, and accelerometers are expensive and time consuming to develop. Charles River Analytics is taking advantage of the Open-Source Virtual Reality (OSVR) framework […]

Assessment and Diagnosis of Vestibular Indicators of Soldier Operational Readiness (ADVISOR)

Wollocko, A., Jenkins, M., Farry, M., and Irvin, S. Presented at the International Symposium on Human Factors and Ergonomics in Health Care: Shaping the Future, San Diego, CA (April 2016) Soldiers who suffer a potentially concussive injury or barotrauma need accurate, timely, in-theater assessment of symptoms. Often this initial assessment and diagnosis must be conducted by first-level […]

Virtual Reality System for the Assessment and Diagnosis of Vestibular Indicators of Soldier Operational Readiness (ADVISOR)

Wollocko, A., Jenkins, M., Irvin, S., and Farry, M. Presented at NextMed / Medicine Meets Virtual Reality (MMVR), Los Angeles, CA (April 2016) Soldiers who suffer a potentially concussive injury or barotrauma need accurate, timely, in-theater assessment of symptoms. Often this initial assessment and diagnosis must be conducted by first-level responders who attempt to assess vestibular symptoms […]

Migrating Real-World Stimulus to Controlled Virtual Reality Environments: Lessons Learned from Transitioning Medical Diagnostic Assessments to the Virtual Realm

Wollocko, A., Jenkins, M., and Farry, M. Presented at the 7th International Conference on Applied Human Factors and Ergonomics (AHFE 2016), Orlando, FL (July 2016) Virtual reality (VR) and augmented reality (AR) capabilities are becoming ubiquitous, with many traditional challenges (e.g., jitter, screen door effects, cost) being overcome as a result of major investments from consumer gaming […]

Applications and Considerations of Augmented Reality Capabilities for Next Generation Human-Computer Interaction to Support Military Shared Mission Command

Wollocko, A., and Jenkins, M. Presented at Human-Computer Interaction International 2016, Toronto, Canada (July 2016) Augmented reality (AR) technology is quickly evolving and providing the capabilities needed to lead the next generation of human-computer interaction, and can be particularly useful in military situations, like Shared Mission Command (MC) and Collaborative Cockpit Displays. To enable traditional software […]

Assessment and Diagnosis of Vestibular Indicators of Soldier Operational Readiness (ADVISOR)

Jenkins, M., Wollocko, A., Irvin, S., and Farry, M. Military Health System Research Symposium (MHSRS), Ft. Lauderdale, FL (August 2015) Soldiers suffering a traumatic brain injury (TBI) or barotrauma need accurate, timely, in-theater assessment of symptoms to inform appropriate return to duty (RTD) decisions. Often, this initial assessment and diagnosis must be conducted by first-level […]

Assessment and Diagnosis of Vestibular Indicators of Soldier Operational Readiness (ADVISOR)

Jenkins, M., Wollocko, A., and Irvin, S. Defense Energy  Innovation Summit, Austin, TX (December 2015) Soldiers suffering a traumatic brain injury (TBI) or barotrauma need accurate, timely, in-theater assessment of symptoms to inform appropriate return to duty (RTD) decisions. Often, this initial assessment and diagnosis must be conducted by first-level responders (e.g., Medics, Corpsmen) who attempt […]

Designing Instructor Support Tools for Virtual Shiphandling Training

Voshell, M., Kilgore, R., Hogan, C., and Young, D. Presented at the Interservice/Industry Training, Simulation & Education Conferece (I/ITSEC), Las Vegas, NV (December 2015) Practice and experience are fundamental to seamanship and shiphandling training, but are significantly limited by platform availability and at sea time. With hands-on experience and at-sea assignments available only to a subset […]

Translating Clinical Vestibular Function Assessment Procedures to a Portable, Low-Cost, Virtual Reality Solution

Wollocko, A., Jenkins, M., Irvin, S., and Farry, M. To be presented at the 2nd International Conference on Knowledge and Software Engineering (ICKSE 2015), Rome, Italy (December 2015) Assessment of vestibular function in adult populations is typically conducted in controlled clinical environments by trained otolaryngologists using costly, specialized medical screening equipment. This limits the ability of […]