Independent AI evaluators
“Frontier AI companies should be evaluated by meaningfully independent third parties rather than evaluators they select or pay for”
8 people · 7 agree · 2 no clear side · 1 unclear · 15 views · 2026-09-14 to 2026-09-28
Who stands where on the statement above, from their own words. A person's side is shown only where two separate readings of the quote agree; otherwise they are under "Side unclear". This page does not say who is right.
Agree 7 people
- ✓Dario Amodei
Amodei outlined a three-step approach that would begin with AI firms welcoming independent third-party evaluators with extensive access to the most advanced systems they’re developing.
AI labs could agree to third-party technology assessments from "embedded evaluators" who would verify safety practices
ongoing employee-like access” to “a team of embedded third-party evaluators (such as METR)
- ✓Elon Musk
instead of grading your own homework, you would at least have competitors grading your homework and raising the alarm if they see concerns
The odds that you will find issues are dramatically greater.
- ✓Sam Altman
Committing to having independent evaluators with employee-like access is a great idea, and we will do the same.
- ✓Geoffrey Hinton, Stuart Russell and Arvind Narayanan
Frontier AI companies should rely on evaluators that are meaningfully independent.
- ✓Zvi Mowshowitz
I agree. That seems like a good list.
- ✓Gabriel Weil
you do not want to let the AI developer hire their own referees
- ✓Drake Thomas
It is also good for AI companies to have oversight from unimpeachably boring and independent sources that even a bad-faith psyop would struggle to find complaints with.
No clear side 2 people
- ~Elon Musk
I think it's probably something that China would agree to.
- ~Zvi Mowshowitz
Then you look at the Big Four auditing firms, but none have the expertise and three of them are Claude shops like Accenture.
Side unclear 2 people
- ·Drake Thomas
It is good for AI companies to have oversight from deeply cracked teams of experts with world-leading experience in investigating frontier alignment problems.
it’ll be harder to say very blunt/weird critical things like “this company is taking on lots of existential risk right now and should immediately stop” from within a large “normal” company
- ·ClementDelangue
He called for mandatory sharing of agent traces.
Week by week
- · 1: Dario Amodei ✓
- · 5: ClementDelangue ·, Geoffrey Hinton, Stuart Russell and Arvind Narayanan ✓, Zvi Mowshowitz ✓, Gabriel Weil ✓, Drake Thomas ·
- · 3: Dario Amodei ✓, Sam Altman ✓, Elon Musk ✓
Built 2026-11-21 06:50 UTC from the news knowledge
graph by code. Every quote was checked against the source's own words; which side a quote takes is a model's reading,
made twice.