Applications and Considerations of Augmented Reality Capabilities for Next Generation Human-Computer Interaction to Support Military Shared Mission Command

Wollocko, A., and Jenkins, M.

Presented at Human-Computer Interaction International 2016, Toronto, Canada (July 2016)

Augmented reality (AR) technology is quickly evolving and providing the capabilities needed to lead the next generation of human-computer interaction, and can be particularly useful in military situations, like Shared Mission Command (MC) and Collaborative Cockpit Displays. To enable traditional software developers to take advantage of novel AR hardware (e.g., Microsoft HoloLens), a foundation of necessary core capabilities are required to support the types of interactions and display concepts that become possible when shifting from a 2-dimensional display to a 3-dimensional augmented world view. One of the most critical capabilities required for almost all immersive AR experiences is the ability to accurately register, locate, and manipulate virtual displays and objects within the user’s real-world view. While seemingly straightforward, this process requires the ability to dynamically register the user’s environment / scene, determine the user’s field of view (FOV) within that scene, and accurately locate, manipulate, orient the target display or object to appear as intended within the FOV of that scene. This problem becomes even more challenging when faced with the need to create persistent displays and objects (e.g., place an item in the world that remains as a user comes and goes from the target environment or as they power cycle their AR viewing device) and when considering the creation of shared multi-user experiences (e.g., having multiple users with differing FOVs accurately viewing the same display or object within a given environment or scene). This poster provides an overview of the authors’ progress towards a solution for this problem by developing an adaptable approach to register a scene, locate displays and objects, and considers the manipulation and persistence of objects within the AR display. To demonstrate this approach, a basic navigation demonstration was created using the Microsoft HoloLens, which will inform future applications.

For More Information

To learn more or request a copy of a paper (if available), contact Arthur Wollocko.

(Please include your name, address, organization, and the paper reference. Requests without this information will not be honored.)