Space Industry and Business News
ROBO SPACE
DARPA taps RTX to attune AI decisions to human values
illustration only
DARPA taps RTX to attune AI decisions to human values
by Staff Writers
Boston MA (SPX) Aug 11, 2023

RTX's BBN division received a contract award to support DARPA's "In The Moment" program. ITM aims to develop the foundations needed for algorithms that are trusted to independently make decisions in scenarios like mass casualty triage and disaster relief, where complex and rapid decisions are needed in dynamic situations where there is often no human consensus and no clear right answer.

"ITM is about more than getting AI to provide the correct answer in very controlled scenarios. We're not talking about training AI on labelled data to help identify a cancerous tumor on an X-Ray," said Alice Leung, Raytheon BBN principal investigator.

"What we're trying to accomplish instead is the ability to create AI systems that humans would allow to make decisions independently in uncontrolled environments. To accomplish this, we need to determine how human experts make really difficult decisions and assess whether to trust the decisions of others. We'll be conducting both decision-making research and trust research."

The Raytheon BBN-led team, which includes Kairos Research, MacroCognition, and Valkyries Austere Medical Solutions, will use a cognitive interviewing technique to understand how experts-in this case, medical professionals and first responders-evaluate information and make tough trade-offs to act decisively at critical decision points.

This qualitative information will be used to design scenario-based experiments to study how differences in an individual's decision-making attributes can explain their choices, and how the alignment of attributes between two different people impacts the willingness to delegate decisions to another. This will enable AI to be tuned to match an expert population, or even to be tuned to match an individual expert.

"Because the way we make decisions varies from person to person, it's unlikely that a one-size fits all trusted AI model exists," said Leung. "Instead, in theory, we should be able to create AI systems that adapt to the user and domain. Decisions are difficult because of uncertainty and trade-offs between competing goals. We want to be able to tune an AI's attributes such as risk tolerance, process focus, or willingness to change plans to better match a user or a group of users."

DARPA is bringing together multiple teams to collaborate on this program. Other teams will focus on the development of prototype AI decision-makers that start with baseline knowledge and can then be tuned to match a set of target attributes. The research products from this program will be integrated and evaluated to determine how well the algorithmic agents were able to make decisions consistent with the target human attributes when faced with difficult scenarios.

The program will also test whether human experts trust these aligned agents over the baseline agents or other actual humans. In these program evaluations of trust, the human experts will be shown a record of decisions in difficult scenarios without knowing whether the decision-maker was an AI or a human.

Work on this contract, which is sponsored by DARPA and the Air Force Research Lab, is being performed in Cambridge, Massachusetts; Dayton, Ohio; and Anniston, Alabama.

Related Links
RTX
All about the robots on Earth and beyond!

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ROBO SPACE
Robots cause company profits to fall - at least at first
Cambridge UK (SPX) Aug 04, 2023
Researchers have found that robots can have a 'U-shaped' effect on profits: causing profit margins to fall at first, before eventually rising again. The researchers, from the University of Cambridge, studied industry data from the UK and 24 other European countries between 1995 and 2017, and found that at low levels of adoption, robots have a negative effect on profit margins. But at higher levels of adoption, robots can help increase profits. According to the researchers, this U-shaped phenomenon ... read more

ROBO SPACE
New method simplifies the construction process for complex materials

Sensing and controlling microscopic spin density in materials

Umbra achieves Commercial SAR milestone with 16-cm resolution

DLR harnesses 3D Printing for efficient production of spaceflight components

ROBO SPACE
Lockheed Martin completes CDR for Tranche 1 Transport Layer Satellites

Northrop Grumman achieves key milestone in Arctic Satellite Broadband Mission

Hisdesat announces the launch of first SpainSat NG satellite for summer of 2024

ATLAS Space launches Freedom Space for Government Missions

ROBO SPACE
ROBO SPACE
Present and future of satellite navigation

New Galileo station goes on duty

Potential earthquake precursor discovered through GPS measurements

Northrop Grumman's new airborne navigation system achieves successful flight test

ROBO SPACE
Military-run Mexican airline to take off in December

NASA software developers take autonomy from simulation to flight

Cathay Pacific rebounds to first-half profit as travel picks up

DLR conducts first flight of HyBird demonstrator

ROBO SPACE
Tough memory device aims for space missions

Simple superconducting device may slash energy use in computing

Novel hardware approach offers new quantum-computing paradigm

Vienna scientists enhance magnonic computing with spin wave insights

ROBO SPACE
Planet completes acquisition of Sinergise; Set to Expand Planet's Earth Data Platform

BlackSky signs Rocket Lab for five launches

IBM collaborates with NASA to launch Geospatial AI on Hugging Face

China launches its latest meteorological satellite

ROBO SPACE
Inner city delivery hubs raise child health fears after UK court battle

Indonesia capital becomes world's most polluted major city: monitor

Tunisian brand turns sea plastic into green couture

Plastic litter in oceans overestimated, study suggests

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.