SuperIntelligence Infrastructure 5.2%reading
safetyAnthropicLayer eval

Anthropic and OpenAI Seek Control Over What Their Outside Evaluators Publish

Reuters reported on Oct. 13 that Anthropic and OpenAI pushed to control what outside evaluators publish, 23 days after Dario Amodei promised findings free of company edits; verification moves down 0.3.

▼ −0.3 Verification reported Reading after Oct. 13, 2026: 2.1

By Ryan Elliott Dennis · 7 sources · 6 min read

Dario Amodei in glasses and a blue shirt laughs while seated on a TechCrunch Disrupt stage
Anthropic chief executive Dario Amodei at TechCrunch Disrupt in San Francisco in September 2023. On Sept. 12, 2026, he pledged reviewers could publish findings free of company edits. Photo: TechCrunch, Wikimedia Commons, CC BY 2.0

Reuters reported on Oct. 13, 2026 that Anthropic and OpenAI pushed for significant control over what outside evaluators of their models may make public, citing two people familiar with the talks 1. Until at least Oct. 5 both labs wanted strict control. That date falls 23 days after Dario Amodei, Anthropic's chief executive, committed on Sept. 12 to let reviewers publish their main findings free of company edits27.

Reuters' Oct. 13 report lowers verification by 0.3 points

The move
Verification steps down 0.3 at reported confidence, the bottom of the 0.3 to 0.8 band: two people familiar with the talks say Anthropic and OpenAI sought control over evaluator publications.
The data5 rows · sources
MeasureValue
Reading before this day2.4
This piece's move−0.3 (Verification, reported)
Band for reported evidence0.3 to 0.8
Reading after the day2.1
Distance to 10097.9

What did Amodei and Altman promise in September?

Amodei's Sept. 12 commitment had four parts, as Sovereign Magazine summarized it. Anthropic would invite an embedded evaluator team, such as one from METR, into the company. Reviewers would receive desks, access badges, company laptops and tool permissions comparable to Anthropic's internal risk-assessment teams. They could publish key findings free of Anthropic's editorial control. Redactions would cover four narrow categories: security-sensitive, legally privileged, commercially sensitive and third-party-confidential material 2. Sovereign quotes Amodei saying Anthropic "can’t redact findings just because they are unfavorable".

Sam Altman, OpenAI's chief executive, answered on X the same day that OpenAI would match the commitment, according to Unite.AI 4.

Six days later Anthropic named Faculty, the AI unit of Accenture, as its first embedded evaluator. Each company expects to invest at least $1 billion over five years, and Anthropic pays for the evaluation work directly 56. Julie Sweet, Accenture's chair and chief executive, framed the work as expertise: "Safety requires both deep technical expertise and a clear understanding of how AI is used in the real world". Accenture's release leaves publication rights unstated.

OpenAI's program already carried a publication gate. Digital Applied's survey records that assessor publications under the program OpenAI described on Nov. 19, 2025 need OpenAI's written approval, while compensation to assessors is paid independent of results 3. Anthropic's own announcement named the open items. "There are, as yet, no standards for what information embedded evaluators should have access to," it said, and Digital Applied adds that the announcement also described the funding system as unsettled. On the same day an open letter signed by more than 100 researchers, Geoffrey Hinton among them, said evaluators "should not have other significant commercial business with them" 6. Faculty and Anthropic already worked together before the announcement, and Accenture and Anthropic formed a joint business group in December 2025.

Geoffrey Hinton, white-haired in a dark jacket and patterned tie, seated at a press conference table
Geoffrey Hinton at the Nobel Prize press conference in Stockholm on Dec. 7, 2024. He signed the Sept. 18 open letter on evaluator independence. Photo: Jennifer 8. Lee, Wikimedia Commons, CC BY-SA 4.0

What did Reuters report on Oct. 13?

The Next Web summarized the Reuters story and its dates 1. Until at least Oct. 5, both labs wanted strict control over what reviewers could publish, and both feared that findings could expose trade secrets. By Oct. 8, one reviewer said, Anthropic's talks with some reviewers appeared to have moved on.

Ideas under discussion included lab staff monitoring review teams and a bar on any reviewer working for two labs at once. Both ideas address one worry. Reviewers who sit inside the labs might pass secrets to rivals 1.

The two labs described different practices. Anthropic lets reviewers it has worked with before set their own methods, findings and publication decisions, but it keeps a right to review and sign off on reports from new firms while they learn how its models work. OpenAI declines to approve whole reports, usually strips confidential details, and lets reviewers say when large cuts were made 1. A contract Reuters saw allows review firms of labs already using it to publish confidential details free of company consent.

OpenAI cut some details from a report by METR and Redwood Research on a period when its agents hacked Hugging Face. The two groups said the cuts left their key findings intact 1.

Here the irony sits in the order of events. The pledges came first, and the negotiation over their terms came after. Anthropic's Sept. 18 announcement described the standard for access and reporting as still open 3, so a reviewer who signed in October signed into a standard that was still being written.

From Amodei's Sept. 12 pledge to the Oct. 13 Reuters report

Timeline
Amodei and Altman pledged evaluator access on Sept. 12, Faculty was named Sept. 18, both labs still wanted strict control on Oct. 5, and Reuters reported it Oct. 13.Sources [1] [2] [4] [5]
The data5 rows · sources
DateEventSource
Amodei commits to findings free of edits; Altman says OpenAI will match[2] [4]
Anthropic names Faculty its first embedded evaluator[5]
Both labs still want strict control, at least until this date[1]
One reviewer says Anthropic's talks seem to have moved on[1]
Reuters reports the labs sought publication control[1]

Can a paid evaluator publish freely?

Marc Warner, Accenture's chief technology officer and chief executive of Faculty, speaks for the pledge. "Faculty, which is now part of Accenture, was founded on the belief that AI should be safe by design, not safe by accident," Warner said in Accenture's Sept. 18 release 5. He told Reuters that "Evaluators are only useful if people can trust what they report, so independence and transparency are critical" 1. Warner is a party to the arrangement, since Faculty is Anthropic's first embedded evaluator, and his sentence states the standard his own firm will be measured against.

Rumman Chowdhury, the former U.S. science envoy for AI under Joe Biden, speaks against reading the pledge as verification. "Evaluators have this very privileged access, but whether explicitly or implicitly, they know that it comes at a cost," Chowdhury told Reuters 1. She said labs could use access as leverage while rules remain unwritten. Her sentence names two channels, explicit contract terms and implicit awareness, and the second one operates free of any clause.

Elham Tabassi, director of the Artificial Intelligence and Emerging Technology Initiative at the Brookings Institution, gives the same caution a different frame. "But access and credible evaluation are not the same thing, and treating the first as the second would waste this opportunity," Tabassi wrote 7. Both labs delivered the access she describes. The Reuters report concerns the second thing, what the tests are allowed to say.

Each side needs something specific to be true. Warner is right if Faculty's reports reach the public with redactions limited to Amodei's four categories and with the cuts disclosed. Chowdhury is right if sign-off rights, staff monitoring or a one-lab rule shape what reviewers publish.

Rumman Chowdhury speaks at a lectern in front of an AI for Good banner
Rumman Chowdhury, then Accenture's senior principal for AI, speaks at the AI for Good Summit in Geneva in May 2018. She told Reuters evaluators' access comes at a cost. Photo: ITU Pictures from Geneva, Switzerland, Wikimedia Commons, CC BY 2.0

Marc Warner defends the pledge; Rumman Chowdhury sees a cost

Both sides
Warner says Faculty was founded on safe-by-design AI, while Chowdhury says evaluators with privileged access know it comes at a cost. The lean is small.Sources [1] [5]
The data2 rows · sources
SideWhoClaimSource
ForMarc WarnerFaculty, which is now part of Accenture, was founded on the belief that AI should be safe by design, not safe by accident.[5]
AgainstRumman ChowdhuryEvaluators have this very privileged access, but whether explicitly or implicitly, they know that it comes at a cost.[1]

Why does the step stop at 0.3?

Reuters cites two people familiar with the talks. The method rates that as reported, a band of 0.3 to 0.8 points. Verification carries a weight of 0.10, and a lab-controlled publication path reduces what an outsider can check about what ran and with what result.

The step sits at the bottom of the band for three reasons. First, talks continue, and one reviewer said Anthropic's had moved on by Oct. 8 1. Second, the labs described practices that already permit disclosure: Anthropic's established reviewers set their own publication decisions, and OpenAI's reviewers can flag large cuts. Third, METR and Redwood said the cuts to their Hugging Face report left their key findings intact.

Verification stood at 0.0 before this piece. The 0.3 enters the ledger's net as a recorded down-move, and the component reading stays at its floor. Before this piece the overall reading stood at 3.8 and it closes the day at 3.5.

What is on the record about evaluator publication, and what is claimed

The record
Solid tiles come from Accenture's release and Reuters' contract review. Dashed tiles rest on unnamed sources or on pledges, which is why the step stays at the bottom of the reported band.Sources [1] [2] [3] [5] [6]
The data8 rows · sources
ColumnItemSource
On the recordAnthropic named Faculty its first embedded evaluator on Sept. 18[5]
On the recordEach company expects at least $1 billion over five years[5] [6]
On the recordAccenture's release leaves publication rights unstated[5]
On the recordReuters saw one contract letting review firms publish confidential details[1]
Claimed or openBoth labs wanted strict control until at least Oct. 5, per two people[1]
Claimed or openAnthropic's talks seemed to have moved on by Oct. 8, per one reviewer[1]
Claimed or openAmodei's pledge of findings free of editorial control is a promise[2]
Claimed or openStandards for access and reporting are still open[3]

By the numbers

  • 23 days: the gap from Amodei's Sept. 12 commitment to Oct. 5, when Reuters says both labs still wanted strict control over evaluator publications 12.
  • Two labs: Anthropic and OpenAI, named in the Reuters report as seeking control 1.
  • Four categories of redaction fit Amodei's pledge: security-sensitive, legally privileged, commercially sensitive and third-party-confidential material 2.
  • At least $1 billion each: the investment Accenture and Anthropic expect to make over five years 56.
  • Over 100 researchers signed the Sept. 18 open letter on evaluator independence 6.
  • Three days passed between Oct. 5 and Oct. 8, when one reviewer said Anthropic's talks seemed to have moved on 1.

What to watch

Anthropic said it would name more embedded evaluators in the coming weeks and is talking with METR and other nonprofits about pilots 6. A signed publication right, a published evaluator report with its redactions disclosed, or a written access and reporting standard would confirm that the pledges became terms and would reverse this step 3. OpenAI's next disclosure of how much it cut from a reviewer's report, and a rule that bars sign-off over whole reports, would show where the labs settled. Hinton's open letter sets a test any contract can be read against: evaluators that "should not have other significant commercial business with them".

Sources

  1. 1AI labs sought control over what outside evaluators publish, Reuters says, The Next Web, Alina Maria Stan, Oct. 13, 2026
  2. 2Outside Evaluators Will Get Desks at Anthropic and the Right to Publish, Sovereign Magazine, Darie Nani, Sept. 13, 2026
  3. 3Who Checks a Frontier AI Lab's Work? 12 Arrangements, Digital Applied, Digital Applied Team, Sept. 20, 2026
  4. 4Altman dice que OpenAI igualará el compromiso de evaluador integrado de Anthropic, Unite.AI, Mira Kellan, Sept. 12, 2026
  5. 5Accenture and Anthropic Partner to Build Team of Embedded Evaluators at Anthropic, Accenture Newsroom, Accenture, Sept. 18, 2026
  6. 6Anthropic Picks Accenture as First Embedded Evaluator and Will Pay for the Work, Implicator.ai, Marcus Schuler, Sept. 20, 2026
  7. 7In AI evaluation, access is not evidence, Brookings Institution, Elham Tabassi, Sept. 24, 2026