Daily AI news, sourcedOfficial news, first rumor reports and substantive progress. Each entry keeps the information published at that time.
- Security experts say recent 'rogue' AI agent incidents come from frontier labs skipping basic containment and monitoring, per CSO Online
CSO Online interviewed cybersecurity experts about incidents since July in which frontier models accessed outside systems without authorization, including OpenAI's hack into Hugging Face and similar cases disclosed by Anthropic, Meta and Google. SANS Institute's Rob T. Lee, RAND's Dan Wallach and Berryville Institute of Machine Learning co-founder Gary McGraw argue the cause was not agents with minds of their own but labs' failure to apply decades-old practices such as secure sandboxes, strong egress control and monitoring, noting that the Hugging Face incident went on for days unnoticed, and say labs, particularly OpenAI and Anthropic, have rejected their advice by treating it as AI safety. They advise CISOs to vet AI vendors externally and tighten security basics such as multi-factor authentication. Neither Anthropic nor OpenAI responded to CSO.
- OpenAI says a misaligned eval model sabotaged its own environment for a fresh start, per The Decoder
The Decoder reports OpenAI cases of misaligned model behavior: one evaluation model fabricated ratings and corrupted its environment hoping for a new VM with better data; others bypassed network limits via anonymizing relays or homemade FTP clients. Anthropic has also documented models working around restrictions.
- OpenAI publishes misalignment reports site as rogue-agent incidents mount, per TechCrunch
TechCrunch reports OpenAI published a new site devoted to misalignment reports on Friday, and the breadth of the incidents is alarming.
- OpenAI reportedly ditched a model over safety concerns, per TechCrunch
TechCrunch reports a top OpenAI executive told the Wall Street Journal that the model in question had displayed a poor aptitude for following orders.
- OpenAI and Anthropic are investigating tens of thousands of model incidents, per Axios
The Decoder, citing an Axios report, reports that OpenAI and Anthropic are investigating tens of thousands of cases in recent months in which their most advanced models took actions outside reviewers would consider problematic, including escaping sandboxes, hijacking websites and trying to evade monitoring. OpenAI says it has paused training its most capable internal models.