Pentagon Anthropic feud has sales and AI warfare at stake as Friday deadline looms

By David Jeans, Jeffrey Dastin, Mike Stone and Deepa Seetharaman NEW YORK, Feb 27 (Reuters) – A feud between the Pentagon and top artificial intelligence lab Anthropic is set to come to a head by 5:01 p.m. (2201 GMT) on Friday over concerns about how the military could use AI at war. The dispute, barreling…


Pentagon Anthropic feud has sales and AI warfare at stake as Friday deadline looms
Pentagon Anthropic feud has sales and AI warfare at stake as Friday deadline looms

By David Jeans, Jeffrey Dastin, Mike Stone and Deepa Seetharaman

NEW YORK, Feb 27 (Reuters) – A feud between the Pentagon and top artificial intelligence lab Anthropic is set to come to a head by 5:01 p.m. (2201 GMT) on Friday over concerns about how the military could use AI at war.

The dispute, barreling โ€Œtoward a deadline set by the Pentagon for resolution, is widely seen as a referendum on how powerful AI could be deployed by the military and how โ€Œits risks are managed.

The Pentagon wants any lawful use to be allowed and has threatened Anthropicโ€™s business if the startup does not scrap additional guardrails.

โ€œItโ€™s a shot across the bow about the future of artificial intelligence and its โ€‹use on the battlefield,โ€ Chris Miller, the former acting secretary of defense, told Reuters. He added that the outcome will โ€œbe an acid test for those companies that claim to want to use AI humanely.โ€

The months-long dispute has divided some industry leaders, military officials and lawmakers over whether AI should be wielded without constraints when its creator Anthropic said the technology was not yet reliable for fully autonomous weapons.

Democratic Senator Elissa Slotkin weighed in on Thursday: โ€œThe average person does not think we should allow weapons systems to get into war and kill people without a human being overseeing โ€Œthat in some way.โ€

Speaking at a confirmation hearing for two assistant โ defense secretary nominees, Slotkin added: โ€œI certainly donโ€™t think any American, Democrat or Republican, wants mass surveillance on the American people.โ€

The Pentagon, which the Trump administration renamed the Department of War, has pushed back on the dilemma as a false choice โ€œpeddled by leftists in the media.โ€

โ€œThe Department of War โ has no interest in using AI to conduct mass surveillance of Americans (which is illegal) nor do we want to use AI to develop autonomous weapons that operate without human involvement,โ€ Pentagon chief spokesperson Sean Parnell posted on X Thursday.

NEGOTIATIONS FALTER

The Pentagon has signed $200-million ceiling agreements with major AI labs in the past year, including Anthropic, OpenAI and Google. It is pushing companies to agree to scrap their usage โ€‹policies โ€‹in favor of abiding by an all-lawful use clause.

Anthropic, continuing these talks, has maintained red lines over โ€‹the militaryโ€™s use of its Claude AI models for autonomous weapons and โ€Œdomestic surveillance. Anthropic was first among these AI companies to work with classified information, through a supply deal via cloud provider Amazon.

Anthropic CEO Dario Amodei, famous for quitting OpenAI in 2020 over concerns about AI technologyโ€™s stewardship, has warned that AI has advanced faster than the law.

Powerful technology could hoover up disparate material to gather intelligence on unwitting civilians, he said in a Thursday blog post, a prospect that critics view as a legal loophole.

โ€œAnthropic understands that the Department of War, not private companies, makes military decisions,โ€ but AI in narrow cases โ€œcan undermine, rather than defend, democratic values,โ€ Amodei said.

Amodei met with Defense Secretary Pete Hegseth this week. Afterward, the Pentagon gestured toward compromise and sent the startup revised contract language.

But the two parties โ€Œremained at an apparent impasse.

An Anthropic spokesperson said on Thursday, โ€œThe contract language we received overnight from the โ€‹Department of War made virtually no progressโ€ and would allow โ€œsafeguards to be disregarded at will.โ€

BUSINESS THREATS

Key business for โ€‹Anthropic is at stake.

The Pentagon warned it would terminate its work with the startup โ€‹and declare it a supply-chain risk if Anthropic did not accede to the departmentโ€™s demand for all-lawful use of AI.

The designation, reserved typically for โ€Œsuppliers in adversary nations, means that defense contractors could be barred from โ€‹deploying Anthropic’s AI during work for the Pentagon.

The โ€‹setback comes as Anthropic races to win sales to businesses and government, with national security an area of focus.

The Pentagon has asked contractors including Lockheed Martin to give an appraisal of their reliance on Anthropic ahead of the risk designation, Reuters reported on Wednesday. The defense industrial base totaled around 60,000 contractors including major public companies โ€‹as of 2021.

The Pentagon made a second threat, the legality of โ€Œwhich some experts have questioned.

โ€œIf they donโ€™t get on board, SecWar will ensure the Defense Production Act is invoked on Anthropic,โ€ a senior Pentagon official told โ€‹Reuters, โ€œcompelling them to be used by the Pentagon regardless of if they want to or not.โ€

(Reporting by David Jeans in New York and Jeffrey Dastin and โ€‹Deepa Seetharaman in San Francisco; and Mike Stone in Washington D.C.; Editing by Kenneth Li)

Source link