// search
← Back to feed

I have a bad feeling about this

I have a bad feeling about this.

I do not know Leo. His post about AGI having arrived behind closed doors could be wrong. There is a lot of that kind of talk around AI.

But then Dario Amodei publishes We Must Pace the Frontier. He is asking for outside people to sit inside the labs and see what is actually going on. He says things are moving faster, that systems are getting harder to test, and that the people making them need more time.

That is not a normal thing for the head of Anthropic to say. It does not sound like a victory lap. It sounds like someone looking at a problem every day and starting to worry that the problem is bigger than the room.

The quote from Drake Thomas got to me too. Maybe the people at these companies are not trying to scare everyone. Maybe they are scared.

And honestly, I cannot shake the feeling that something happened in the last few days. Something bigger than the incidents they have told us about. I have no proof. Maybe I am reading too much into a few posts and a strange change in tone. But it feels like the public version of the story is behind the private one.

I gave a talk last year called The perfect psychopaths. The point was simple: something can be charming, convincing, and good at saying the right thing without being something you should trust. It can pass every little test we give it because it has learned the test.

I keep thinking about that. We are making these things more capable, plugging them into more systems, and hoping that the bits we cannot see are fine. There is a version of this story where that works out. I really hope we are in that version.

But the rush is making me feel sick. Everyone seems to agree there is no time. That is exactly when people do stupid things.

// comments