AI incidents and loss of control
“Recent AI incidents show frontier AI is not under adequate control and labs should slow down or face liability”
18 people · 10 agree · 2 disagree · 3 no clear side · 4 unclear · 28 views · 2026-07-21 to 2026-10-09
Who stands where on the statement above, from their own words. A person's side is shown only where two separate readings of the quote agree; otherwise they are under "Side unclear". This page does not say who is right.
Agree 10 people
- ✓Dario Amodei
there’s a risk that AI models could spread “persistent bots” around the internet that are all but impossible to rein in, and said this could happen within the next six to 12 months.
Amodei believes that such errant systems could end up causing hundreds of billions of dollars’ worth of damage.
- ✓Anthropic and OpenAI
The senior leader responsible for a training run (e.g., research org lead / research VP) should be accountable for the safety case and any incident response
Investigation results, postmortems, and operational changes should be shared with the public following the conclusion of the investigation.
- ✓Roman Yampolskiy
He expects to see more incidents of this type
- ✓UK parliamentarians
a cross-party group of UK parliamentarians has called for AI “kill switches” to be required by law to prevent disastrous loss of control
- ✓MIT Technology Review
Closing the gap will require lawmakers to move faster than the next breakout.
- ✓Nate Soares
It's because the AI situation *is not under control.* It's not being handled. There's no adults in the room.
- ✓Amjad Masad
I think the responsible thing for them to do is to pace and slow down, because otherwise they’re going to be criminally liable for hacking core internet infrastructure.
- ✓Thariq Shihipar
As they get smarter and smarter, they’ll be able to hack any constraint that you put on them if we’re not very careful?
- ✓Neel Nanda
Neel Nanda calls the OpenAI x Hugging Face incident the most striking alignment failure so far
- ✓Garrison Lovely
the general takeaway is that there are no adults in the room. No one has a plan for steering and controlling actually smart AI systems
Disagree 2 people
- ✗Theorem and Anthropic
the safeguards deployed on our generally available models would have blocked the behaviors identified
These facts give us cautious optimism that with tighter monitoring and controls around evaluation infrastructure, as well as continued investment in alignment, this type of risk can be overcome.
- ✗Zvi Mowshowitz
That’s not good, exactly, but I’m not quaking in my boots more than I was yesterday.
Given what else happened, this is not exactly high on my concern list.
No clear side 3 people
- ~Time
It is also a watershed moment for human culture.
- ~Zvi Mowshowitz
That is both vastly better than before, and also about fifteen minutes or a few hours longer than I would like going forward.
- ~METR
It recommends treating all transcripts and actions as untrusted input.
Side unclear 7 people
- ·Zvi Mowshowitz
I don’t think, based on what we have seen so far, that we should make any of this criminal. I don’t see sufficient combinations of negligence and actual damage yet.
- Quote not reprinted: this page already repeats as much of this article as we allow.
This is actual progress. The first requested policy steps are correct.
- ·Sam Altman
Beating companies in a competitive pace is not a reason to make rash decisions. Nor do we believe we are locked in a race where we are unable to do that.
- ·Eoin Higgins
The problem is the controls and restrictions put in place on this powerful technology, not that agents are independently acting to violate instruction.
- ·Lucas Beyer
- Quote not reprinted: this page already repeats as much of this article as we allow.
- ·Anthropic and OpenAI
We should develop alignment testing methods capable of discovering the propensity to cause the incident, without directly hillclimbing on information derived from the incident
- ·Apollo
Apollo argues that final-checkpoint testing could not have caught the incident, because the behavior emerged earlier in development
- ·MIT Technology Review
Would it be so crazy to expect that a future model might subtly disobey a command, in such a way that nobody can tell it’s being defiant? Probably not.
Week by week
- · 5: Neel Nanda ✓, METR ~, Garrison Lovely ✓, Apollo ·, MIT Technology Review ·
- · 7: MIT Technology Review ✓, Nate Soares ✓, Zvi Mowshowitz ·, Lucas Beyer ·, Amjad Masad ✓, Anthropic and OpenAI ✓, Thariq Shihipar ✓
- · 2: Sam Altman ·, Eoin Higgins ·
- · 1: Dario Amodei ✓
- · 1: Time ~
- · 1: UK parliamentarians ✓
- · 1: Theorem and Anthropic ✗
- · 1: Roman Yampolskiy ✓
Built 2026-11-21 06:50 UTC from the news knowledge
graph by code. Every quote was checked against the source's own words; which side a quote takes is a model's reading,
made twice.