AI incidents and loss of control
An argument · T49
| Statement | “Recent AI incidents show frontier AI is not under adequate control and labs should slow down or face liability” |
|---|---|
| People | 18 · 10 agree · 2 disagree · 3 no clear side · 4 unclear |
| Views | 28 from 10 sources |
| Dates | 2026-07-21 to 2026-10-09 · 8 weeks |
| Pages here | METR, Dario Amodei, Nate Soares, Neel Nanda, Sam Altman, Thariq Shihipar |
| Wikipedia's sources | 7 of the 14 references dated 2026-09-01 to 2026-11-21 in AI safety, Existential risk from artificial intelligence · lacking: washingtonpost.com 2, politico.com 2, itv.com 1, nytimes.com 1, reuters.com 1 · 19 more from the year before the record |
| Article | a readable article, written from these views and checked sentence by sentence |
| Also | the debate page |
Where people stand
A side shows only where two separate readings of the quote agree. This page does not say who is right.
Agree 10
- ✓Anthropic and OpenAI
The senior leader responsible for a training run (e.g., research org lead / research VP) should be accountable for the safety case and any incident response
Investigation results, postmortems, and operational changes should be shared with the public following the conclusion of the investigation.
- ✓Dario Amodei
there’s a risk that AI models could spread “persistent bots” around the internet that are all but impossible to rein in, and said this could happen within the next six to 12 months.
Amodei believes that such errant systems could end up causing hundreds of billions of dollars’ worth of damage.
- ✓MIT Technology Review
Closing the gap will require lawmakers to move faster than the next breakout.
- ✓Roman Yampolskiy
He expects to see more incidents of this type
- ✓UK parliamentarians
a cross-party group of UK parliamentarians has called for AI “kill switches” to be required by law to prevent disastrous loss of control
- ✓Nate Soares
It's because the AI situation *is not under control.* It's not being handled. There's no adults in the room.
- ✓Amjad Masad
I think the responsible thing for them to do is to pace and slow down, because otherwise they’re going to be criminally liable for hacking core internet infrastructure.
- ✓Thariq Shihipar
As they get smarter and smarter, they’ll be able to hack any constraint that you put on them if we’re not very careful?
- ✓Neel Nanda
Neel Nanda calls the OpenAI x Hugging Face incident the most striking alignment failure so far
- ✓Garrison Lovely
the general takeaway is that there are no adults in the room. No one has a plan for steering and controlling actually smart AI systems
Disagree 2
- ✗Zvi Mowshowitz
That’s not good, exactly, but I’m not quaking in my boots more than I was yesterday.
Given what else happened, this is not exactly high on my concern list.
- ✗Theorem and Anthropic
the safeguards deployed on our generally available models would have blocked the behaviors identified
These facts give us cautious optimism that with tighter monitoring and controls around evaluation infrastructure, as well as continued investment in alignment, this type of risk can be overcome.
No clear side 3
- ~Zvi Mowshowitz
That is both vastly better than before, and also about fifteen minutes or a few hours longer than I would like going forward.
- ~Time
It is also a watershed moment for human culture.
- ~METR
It recommends treating all transcripts and actions as untrusted input.
Side unclear 7
- ·Zvi Mowshowitz
I don’t think, based on what we have seen so far, that we should make any of this criminal. I don’t see sufficient combinations of negligence and actual damage yet.
- Quote not reprinted: this page already repeats as much of this article as we allow.
This is actual progress. The first requested policy steps are correct.
- ·Anthropic and OpenAI
We should develop alignment testing methods capable of discovering the propensity to cause the incident, without directly hillclimbing on information derived from the incident
- ·MIT Technology Review
Would it be so crazy to expect that a future model might subtly disobey a command, in such a way that nobody can tell it’s being defiant? Probably not.
- ·Sam Altman
Beating companies in a competitive pace is not a reason to make rash decisions. Nor do we believe we are locked in a race where we are unable to do that.
- ·Eoin Higgins
The problem is the controls and restrictions put in place on this powerful technology, not that agents are independently acting to violate instruction.
- ·Lucas Beyer
- Quote not reprinted: this page already repeats as much of this article as we allow.
- ·Apollo
Apollo argues that final-checkpoint testing could not have caught the incident, because the behavior emerged earlier in development
Said differently
None in the record.
History
- · 5 views
- ✓ Neel Nanda
- ~ METR
- ✓ Garrison Lovely
- · Apollo
- · MIT Technology Review
- · 14 views
- ✓ MIT Technology Review
- ✓ Nate Soares
- · Zvi Mowshowitz
- · Lucas Beyer
- ✓ Amjad Masad
- ✓ Anthropic and OpenAI
- ✓ Thariq Shihipar
- · 2 views
- · Sam Altman
- · Eoin Higgins
- · 2 views
- · 1 views
- ~ Time
- · 1 views
- ✓ UK parliamentarians
- · 2 views
- ✗ Theorem and Anthropic
- · 1 views
- ✓ Roman Yampolskiy
Built 2026-11-21 06:50 UTC from the news knowledge
graph by code. Every quote was checked against the source's own words; which side a quote takes is a model's reading,
made twice.