Safety standard for shipping AI
An argument · T3
| Statement | “Labs should not ship frontier AI models unless they are proven safe” |
|---|---|
| People | 6 · 5 agree · 3 disagree · 3 no clear side |
| Views | 18 from 4 sources |
| Dates | 2026-09-23 to 2026-10-08 · 3 weeks |
| Pages here | David Robinson, Sam Altman |
| Wikipedia's sources | 5 of the 9 references dated 2026-09-01 to 2026-11-21 in Regulation of artificial intelligence, AI safety · lacking: politico.com 2, reuters.com 1, itv.com 1 · 20 more from the year before the record |
| Article | a readable article, written from these views and checked sentence by sentence |
| Also | the debate page |
Where people stand
A side shows only where two separate readings of the quote agree. This page does not say who is right.
Agree 5
- ✓Anthropic and OpenAI
structured safety documentation should be required before continuing any frontier reinforcement learning training run
Ideally, such documentation would rise to the level of “safety cases”
The safety case should be reviewed by members of senior leadership, who should each have the ability to veto the run
Safety features such as monitoring and auto-pausing should fail closed
- ✓David Robinson
frontier labs need to run like nuclear-power plants or busy airports, with layers of redundancy and careful, time-consuming planning
AI companies need to rely more on the safety expertise that already exists in other fields. And second, before we create systems significantly more capable than the ones we have today, we need new science
the time for trial and error is over. Achieving something much closer to perfection the first time is essential because iteration after a mistake may not be possible.
Companies do not have anything close to certainty that good scores on their alignment tests actually mean a good model: Models might detect when they are being tested, and behave differently when they’re deployed.
- ✓Sam Altman
we should not train models that we cannot make an extremely strong case that we will be able to keep under human control
- ✓Jensen Huang
then I think the answer is that we have to shut the labs down. Because the cost to humanity, the damage is too great.
- ✓Ryan Lowe
Ryan Lowe calls for nuclear-style layered systems safety at the labs
Disagree 3
- ✗Sam Altman
“the world should accept some bad things happening” for the technology’s benefits
- ✗Jensen Huang
The fact of the matter is, there are plenty of incentives for them to do it right. So I have to disagree with your premise that somehow somebody’s pushing them to do this. Nobody’s pushing them to do this.
- ✗Zvi Mowshowitz
The Huang Rule is actually way too harsh.
No clear side 3
- ~Anthropic and OpenAI
acknowledging the challenges of making them as rigorous for AI models as for aviation or nuclear power, due to the emergent complexity at each new level of AI capability
- ~Sam Altman
It’s certainly incorrect to talk about this only as an engineering problem.
- ~Zvi Mowshowitz
Either Kimi models are capable enough to provide uplift with bioweapons and assassinations, or they’re not. There is no ‘it is capable enough but no one can jailbreak it.’
Side unclear 1
- ·Jensen Huang
I wouldn’t be surprised if the amount of compute necessary to develop these models increased by a factor of 10, because the evaluation is so rigorous.
Said differently 2
Quoted on both sides of one statement. That is not shown as a change of position: the words, the setting and the question differ. Read the quotes.
Sam Altman
- ✓
we should not train models that we cannot make an extremely strong case that we will be able to keep under human control
- ✗
“the world should accept some bad things happening” for the technology’s benefits
Jensen Huang
- ✓
then I think the answer is that we have to shut the labs down. Because the cost to humanity, the damage is too great.
- ✗
The fact of the matter is, there are plenty of incentives for them to do it right. So I have to disagree with your premise that somehow somebody’s pushing them to do this. Nobody’s pushing them to do this.
History
- · 3 views
- ✓ Ryan Lowe
- ✗ Sam Altman
- ~ Zvi Mowshowitz
- · 10 views
- ✓ Anthropic and OpenAI
- ~ Sam Altman
- ✓ David Robinson
- · 5 views
- ✓ Sam Altman
- ✓ Jensen Huang
- ✗ Zvi Mowshowitz
Built 2026-11-21 06:50 UTC from the news knowledge
graph by code. Every quote was checked against the source's own words; which side a quote takes is a model's reading,
made twice.