JARVIS

A system for discovering novel solutions to
cyber-physical systems design problems

A system for discovering novel solutions to cyber-physical systems design problems

Joint, Adaptive, Robust Visualization and Interaction System (JARVIS)

JARVIS combines human users’ deep expertise and design intuition with a machine’s ability to explore and characterize vast search spaces to discover novel solutions to cyber-physical systems design problems.

Cyber-physical systems design is extremely complex, involving dozes of domains, and requiring subject matter expertise from designers and engineers across many disciplines. JARVIS has the potential to allow humans and machines to work collaboratively, mitigating the potential biases of human designers, while still incorporating human insights and creativity into the design process. Part of this vision is that designers will also be able to review and direct the activity of AI co-designers throughout the systems engineering lifecycle, providing critique and guiding design outcomes.

“What’s interesting about JARVIS and the SDCPS program is that we’re not just using AI to exhaustively explore a design space; we’re also creating tools that help engineering teams discover and understand promising—but possibly very unconventional—AI design outcomes, injecting their own unique expertise to seed and refine these designs as part of a collaborative human-machine process.”

Ryan Kilgore Headshot
Dr. Ryan Kilgore,
VP, UX Innovation and
Principal Investigator on the JARVIS effort

JARVIS banks on a symbiosis between humans and AI to serve two functions. First, it helps system designers explore the space of the possible to find innovative new designs. Using the tool’s effective human-machine interface (HMI), designers can provide feedback to the AI to guide its exploration of the design space. Second, JARVIS helps designers refine specific components in new or existing designs to fine-tune each design’s ability to meet requirements. The tool provides a way for designers to interact with and understand the results of AI.

The advantage of using AI‑human symbiosis as the basis for the tool is that it harnesses the best of both. AI can churn through millions of design candidates and conduct early performance assessments to nudge designers toward new and potentially promising design directions. On the other hand, humans are good at understanding the limitations and practicality of the designs and using intuition to guide the design process. Working together enables wider and more optimized choices.

While traditional design follows a linear iterative path, JARVIS lets designers explore designs, then go back to previous designs and try different choices, and even merge great ideas from two streams of exploration. JARVIS enables optimization for any relevant parameter, whether that be material cost, speed and maneuverability of a vehicle, weight, or power consumption. The tool is agnostic to the specific domain of the design, so it is equally suited to exploring designs for air vehicles, underwater vehicles, or other systems.

Early use cases of JARVIS for DARPA explored the efficient “correct-by-construction” design of cyber-physical systems like aerial and underwater vehicles. In aerial vehicles, for example, JARVIS allowed design teams to explore what kinds of designs would deliver a sharper turning radius or faster acceleration. The correct-by-construction approach ensures that design candidates are put through their paces, so the final choice is sure to meet required criteria.

JARVIS is being developed under the Symbiotic Design for Cyber Physical Systems (SDCPS) program. The goal of SDCPS is to enhance innovation in design through AI-based approaches that dramatically reduce the time from system inception to deployment (from years to months). The team plans for JARVIS to provide the bridge between that AI tech and human experts, and enable engineering teams to create highly performant military-relevant cyber-physical systems on unprecedented timelines.

Contact us to learn more about JARVIS and our other human-AI teaming capabilities.

This material is based upon work supported by the United States Air Force and DARPA under Contract No. FA875020C0074. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the United States Air Force and DARPA.

Our passion for science and engineering drives us to find impactful, actionable solutions.