When AI models refuse to fight hackers

In the race to fend off AI-enabled cyber threats, security teams are confronting a new problem: The AI models they rely on to investigate attacks can suddenly refuse to help.Why it matters: While AI giants race to build AI tools that can respond quickly to hacking or other malicious online threats, strict guardrails on their most powerful models lock out defenders mid-investigation, leaving them scrambling for alternatives at critical moments.What's happening: OpenCode, an open-source AI coding agent, said it was compromised over the weekend, allowing attackers to obtain API keys belonging to some customers, including keys for OpenAI, Anthropic and Google services.OpenCode said the breach was "related to a large scale distillation attack that impacted 1.4% of OpenCode Console users." OpenCode co-creator Dax Raad said attackers had been targeting its systems continuously for 48 hours, forcing the company to keep its own AI agents running around the clock to respond.OpenAI, Google and Anthropic have said they worked with affected customers to revoke exposed API keys and address unauthorized usage charges.Zoom in: Raad said on X that frontier AI models initially helped investigate th…

≈