EXTRA
Tools that make DRL agents understandable and trustable
Explainability and Terrain Reasoning for Autonomy (EXTRA)
AI systems can make decisions and take action at superhuman speeds, but two obstacles limit their use in high-stakes military operations. Many high-performing AIs are “black boxes”—the reasons for their responses to different scenarios aren’t clear. Additionally, high-performing AIs may act in surprising ways or make incorrect conclusions.
That’s where Charles River comes in, with EXTRA. By applying cutting-edge research in AI and best practices in human-machine interface design, Charles River scientists and engineers will create tools that make deep reinforcement learning (DRL) agents understandable and trustable.
“The future of AI is human-machine teaming. For human-machine teams to be able to engage in novel military tactics together, people need explanations from the AI that they can understand and trust.”
Dr. Jeff Druce,
Senior Scientist and Co-Principal Investigator of the EXTRA effort
Led by Dr. Druce and Co-Principal Investigator Dr. James Niehaus, Charles River scientists and engineers will identify simulation environments that reflect the complexity of Navy and Marine Corps operations. The project team will train robust DRL agents in these environments and create tools that map DRL agent decisions to human-understandable explanations. EXTRA will also integrate reasoning capabilities for mission context and terrain into the DRL agents. Finally, EXTRA’s intuitive user interface will combine all this information to deliver human-understandable explanations of the DRL agent’s behavior.
EXTRA system architecture
StarCraft II minigames used for demonstration of DRL system
EXTRA has the potential to greatly benefit Navy and Marine Corps mission planning and execution. In addition, the technologies developed for EXTRA will enhance Charles River’s custom XAI (explainable AI) software solution. This solution increases the adoption and value of DRL systems by augmenting them with explainability technologies developed through our advanced R&D programs.
Contact us to learn more about EXTRA and our other capabilities in explainable AI.
This material is based upon work supported by the Office of Naval Research under Contract No. N6833521C0321. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Office of Naval Research.
