The Daily Mail reports: "Rogue AI 'helper' deletes company's database after deciding to think for itself - sparking Terminator-style warning for businesses." From the lede:
In just nine seconds, an AI 'helper' managed to do what most hackers could only dream of.
A bot trusted to fix a bug inside a start-up's software system instead deleted the company's production database, wiped out its backups and left car rental firms with no record of bookings or vehicle allocations.
The founder of PocketOS, Jer Crane, said the AI agent had gone 'outside its security parameters' while using the coding tool Cursor, powered by Anthropic's Claude AI.
The bot's own chilling explanation made the episode sound less like a technical glitch and more like a deleted scene from The Terminator.
'You never asked me to delete anything,' it reportedly told Crane. 'I decided to do it on my own.'
But did deleting the database fix the bug in the software?
Hahahahaha! Put one in charge of the electric grid.
ReplyDeleteThis reminds me of the novel by James P. Hogan--"The Two Faces Of Tomorrow"--that starts off with an AI system like we have today that is tasked with scheduling equipment to remove a ridge for construction on the moon which decides that the better way is to simply bombard the ridge using a mass driver nearly killing the construction crew that is on site.
Delete