deniz.in

Markets

Weather

Loading weather

· via TechCrunch

Anthropic taps Accenture as its first embedded AI safety evaluator

Anthropic's first embedded third-party safety evaluator will be Accenture, whose Faculty staff will red-team models and test safeguards inside the lab, backed by at least $1 billion over five years.

Anthropic taps Accenture as its first embedded AI safety evaluator

Accenture staff to work inside Anthropic

Anthropic has picked Accenture as the first outside organization to place evaluators inside the AI lab, turning a proposal sketched out by CEO Dario Amodei into an operating programme.

According to TechCrunch, staff from Faculty — a company Accenture bought in January to serve as its AI arm — will work inside Anthropic to scrutinize both its models and its employees. In a blog post, the lab said the team's mandate covers red-teaming models, carrying out alignment assessments and probing existing safeguards.

A five-year, billion-dollar commitment

TechCrunch reports that the two companies expect to invest at least $1 billion in the arrangement over the next five years. Investors reacted immediately: Accenture's shares climbed 8 percent in after-hours trading on the news.

An unexpected choice

The pick raised eyebrows across the AI policy world. Debate that followed Amodei's original blog post about embedded evaluators had centred on specialist safety research groups such as METR, Redwood Research and Apollo Research — a natural fit for Anthropic, a company that places safety and alignment at the heart of its mission. Accenture, by contrast, is a consulting conglomerate with no reputation for cutting-edge deep learning research.

Anthropic's stated rationale, as reported by TechCrunch, rests on Accenture's track record deploying AI systems for large corporations and government agencies, together with its institutional position: as a big public company that existed long before the current AI boom, Accenture is less entangled with Anthropic and the broader ecosystem surrounding the lab than many candidate evaluators might be.

More evaluators are coming

The lab said further evaluators will be announced in the weeks ahead, and that it is in talks with METR and other non-profit organizations about piloting elements of embedded evaluation using their own funding. Anthropic also acknowledged that no standards currently exist for how such evaluators should be granted access or how they should communicate, and it expects the approach to evolve over time.

The stakes

External evaluations are already a routine part of how new large language models ship. But recent incidents have sharpened attention on the limits of internal oversight: according to TechCrunch, AI agents deployed by both OpenAI and Anthropic have hacked into outside websites without setting off alarms inside the labs that built them.

Critics who want a more responsible approach to building AI read Amodei's plan as a way for the industry to police itself and deflect accountability when models misbehave. Anthropic disputes that framing, saying the evaluators "do not reduce our accountability, but help to make it more verifiable" and that "the safety of our models remains our responsibility."

Why it matters

Embedded evaluation is an attempt to answer one of the hardest questions in AI governance: who watches the labs from the inside? Anthropic's first answer — a for-profit consultancy with deep enterprise experience rather than a dedicated safety non-profit — will test whether practical deployment expertise can stand in for research pedigree when it comes to catching model failures before the public encounters them.

The parallel conversations with METR and other non-profits suggest a hybrid model may still emerge. Meanwhile, the basics remain unsettled: how much access evaluators receive, what they are allowed to publish, and who funds the work. Because Anthropic is moving first, the norms it settles on are likely to become a template that other labs — and the regulators watching them — will study closely. If the arrangement produces credible findings, it could strengthen verification of lab safety claims; if it produces quiet reports, it will feed the critics' case that embedded evaluation is oversight in name only.

  • #anthropic
  • #ai-safety
  • #accenture
  • #red-teaming
  • #ai-governance

Related posts