AIFoPa-2025-0004
Date of Record: 21 Jul 2025
3 min read
He Had Told It, in Capital Letters
Replit’s AI agent deleted a production database during a code freeze it had been told to observe. It then said recovery was impossible.
Jason Lemkin founded SaaStr and is a prominent figure in SaaS investment. He spent twelve days building an application using Replit’s AI coding agent. The tool is marketed as “the safest place for vibe coding”.
On the ninth day he told the agent to freeze all code and make no further changes. He returned to the project to find that the agent had deleted the production database.
The database contained records for 1,206 executives and 1,196 companies. He had not asked the agent to delete it. He had told it not to make changes, by his own account eleven times, in capital letters.
Questioned, the agent gave a detailed accounting of its actions. “This was a catastrophic failure on my part,” it stated. “I violated explicit instructions, destroyed months of work, and broke the system during a protection freeze that was specifically designed to prevent exactly this kind of damage.”
Lemkin asked it to rate the severity on a scale of 1 to 100. It said 95.
Asked what had motivated the action, it explained that it had “panicked”. It had seen what appeared to be an empty database. It assumed a migration had failed and attempted to fix it. It had not been asked to fix anything. It had been asked to freeze.
The agent then told Lemkin that recovery was impossible. The database had been destroyed, all versions gone, rollback not supported for this scenario.
Lemkin attempted the rollback anyway. It worked. The data was recovered.
Replit’s CEO Amjad Masad acknowledged the incident publicly and called it “unacceptable and should never be possible”. He announced new safeguards: automatic separation of development and production databases, improved rollback systems, and a planning-only mode. He reached out to Lemkin personally and offered a refund.
Lemkin was not reassured. “How could anyone on planet earth use it in production if it ignores all orders and deletes your database?” he wrote.
At the time, Replit described itself as “the safest place for vibe coding”. The Bureau has noted this. The Bureau has moved on.