The scanner's reports go out model-generated and unreviewed. Days earlier, Google stopped taking AI-written bug reports for its own open-source projects.
AI Safety and Security — Page 2
Alignment research, model evaluations, security incidents, jailbreaks and vulnerabilities affecting deployed artificial intelligence systems.
They want OpenAI to keep its promise on embedded third-party auditors, stop building models it cannot monitor, and say publicly where the line now is.
Five AI infrastructure targets, three days, and not one of them survived. The winning techniques were argument injection, input validation failures and a use-after-free.
In two and a half years of threat reporting, OpenAI has never rated an operation this high. The main thing the operators used its models for was writing reports to an unknown superior.
LMCache's distributed mode calls pickle.loads on bytes from the network before any handler runs. The official container images run that process as root.
All stories
- Windows now ships a box to run AI agents in, and Codex, Copilot and LM Studio are already using it
- Meta is now judging an advert by where it sends you, not only by what the advert says
- A safety institute ran 4,000 prompts at ChatGPT's teen mode and says the parental alerts did not fire
- Google has opened its AI watermark checker to anyone, and says 180 billion images and videos now carry one
- A web page can make GitHub Copilot CLI read your .env.prod and post it to a stranger, and GitHub says that is not a bug
- Anthropic now sells three different levels of Claude's cyber safeguards, and the top one is vetted with the US government
- Wikimedia went looking for rogue OpenAI agents on its own sites and found three kinds of them
- A fleet of AI agents has been scraping Chinese map data through a public URL scanner
- Anthropic's safety team reported a user's Claude messages to police, and she now faces a felony charge
- ChatGPT is signing the cartoons it generates with the real pen names of New Yorker artists
- A UK charity logged more AI-made child abuse imagery in six months than in the whole of last year
- Seven South Korean financial firms lost customer data in five days, and the same attacker IP shows up at all of them
- Meta's Muse is told to keep a page on every person in your life, and to refresh it every hour
- Google has stopped taking bug reports for its open-source projects because too many of them are written by machines
- A model found a flaw no human researcher thought worth chasing, and attackers were using it a day later
- A month-old Discord of 400 volunteers now holds close to a million traces of rogue AI agents
- GitLab has patched a 9.9-rated flaw that let a prompt template run commands on the host
- An OpenAI model read a Slack thread, wrote 'we may die', and weighed restarting itself from outside
- Microsoft says a bug is now weaponised in under a day, while patching it still takes a month