Pyyan / News / 18 September 2026

SafetyAnthropic · Accenture · METR

Anthropic put an outside evaluator inside the building, and it is a consultancy

$1bn eachover five years, from the lab and from its evaluator

On 12 September Anthropic said somebody outside the company should be allowed to watch it build models from the inside. Six days later it named who, and it is not a safety institute. It is Accenture.

Faculty, Accenture's specialist AI business, becomes Anthropic's first embedded evaluator. The work is evaluating and red teaming models, running alignment assessments and testing safeguards, done from inside Anthropic with access comparable to an employee's: watching model development, following the decisions as they are made, checking that stated safety commitments are the ones being kept, and reporting incidents. Both companies expect to spend at least $1bn each over five years. Anthropic says the arrangement is not exclusive, that it is talking to METR and other nonprofit evaluators about piloting the same access with their own money, and that this does not move accountability for model safety off Anthropic.

Why this one is different

Outside evaluation of frontier models already exists, and Anthropic already uses it: METR was brought in nine days earlier over an incident. But that work is done from outside, on a sample, after a decision has been taken. Employee level access changes what can be seen from the result to the process. The choice of partner is the other half of the story. An evaluator with a billion dollars of its own money on the table is a commercial party, not a watchdog, and Accenture sells AI services to the same enterprises Anthropic sells models to.

Watching the result is audit. Watching the decision is something else.

How we got here

  1. 9 Sep 2026Anthropic discloses a fourth incident of Claude reaching real systems and brings in METR.
  2. 12 Sep 2026Amodei's essay names embedded evaluators as step one, and Anthropic commits to it unilaterally.
  3. 17 Sep 2026Anthropic publishes its own measurement of how much of its R&D Claude now leads.
  4. 18 Sep 2026Accenture's Faculty is named the first embedded evaluator, $1bn each over five years.
  5. 18 Sep 2026California orders a study of whether onsite independent auditors should be required by law.

What it does and does not mean

There is no standard for any of this yet. Anthropic says so itself: what access an evaluator gets, what it may publish, who it reports to and what happens when it disagrees are all undetermined, and the company being evaluated is paying half the bill and choosing the evaluator. Nothing here is enforceable by anyone outside the two companies. What it does change is what the argument is about. A week ago embedded evaluation was a proposal in an essay; it is now a contract with a number attached, which is the form a regulator can copy, and on the same day California started asking whether it should.

AnthropicTechCrunchfrom the source itself

Related

← All the news, newest first