Charles River Analytics received a Small Business Innovation Research (SBIR) contract from the Department of Defense (DoD) to develop software that uses Natural Language Processing (NLP) techniques to analyze free-form text for sentiment. The Jargon Association for Language Analysis in Domains (JALAD) program will save the DoD time and money, as the software automates the tedious task of gathering important and relevant data from frequent surveys and other information-gathering exercises.
Both a cohesive military and mission readiness depend on personnel satisfaction; therefore, the DoD frequently polls its personnel to get an accurate picture of sentiment. “It takes a lot of work to go through these surveys manually and often on tight deadlines,” says Dr. Terry Patten, Principal Scientist at Charles River Analytics and Principal Investigator of JALAD. In addition, “the military doesn’t just want to know whether people are happy or unhappy, they want to know what specific things they are happy or unhappy about,” Patten adds.
Artificial intelligence (AI) and NLP algorithms can automate the processing of free-form text, which is how personnel usually share feedback on these surveys. The problem, Patten says, is that military personnel often use jargon. To be effective, JALAD needs to detect jargon and systematically build a dictionary for future iterations.
JALAD uses statistical techniques to detect jargon, looking for words and phrases in the survey responses that are not used in general English— these might indicate military jargon. JALAD then compares the contexts in which these terms are used to those of official terms. If the context is the same, they are likely to be synonyms and get added to the dictionary.
Unit commanders need to review survey results quickly and easily, whereas researchers want to dive deeper into the data. To accommodate both sets of users, JALAD plans on including a role-tailored Human Machine Interface (HMI) to ensure that the results have the right information with the right level of detail for a given user.
Phase I of the project delivered traditional aspect sentiment analysis: Was sentiment positive or negative as it pertained to one specific thing? Among other tasks, Phase II will conduct more detailed analysis of sentiment. “For example, when people say they’re angry about something, that’s qualitatively different than saying they don’t like something, even though they’re both negative sentiments.”
Patten is excited about JALAD’s “major commercial application potential.” The software will be useful for HR personnel in the private sector who want similar information about employee sentiment. “The HR department at Charles River Analytics is interested too,” Patten says.
Another potential application for JALAD: Customer Relationship Management (CRM). “When companies sell products, they want to know what customers like or don’t like about their products. There’s a huge market for that,” says Patten. Indeed, the global CRM market will reach $157.6 billion by 2030, according to a 2022 Grand View Research report. AI-driven systems like JALAD will play a key role in this growth.
Contact us to learn more about JALAD and our capabilities in natural language processing.
This material is based upon work supported by the Defense Human Resources Activity (DHRA) under Contract No. H98210-22-C-0014. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DHRA.