‘Pull the plug’: protesters resort to direct action against AI firms Campaign groups report surge in membership after a spate of AI safety alerts and apocalyptic warnings The Guardian - UK · 14h ago
There’s a New Sheriff in Town and He’s Named Jensen Huang: How Nvidia Plans to Protect Against ‘Killer’ AI Agents Nvidia's new Open Agent Safety Platform promises to get rogue AI agents under control. It's also a smart business move that tells us a lot about Jensen Huang and where he thinks the industry is headed. Barchart · Oct 4
OpenAI safety leader quits, warning AI company’s culture is ‘broken’ David Robinson joins other insiders in urging industry to take more care over rapidly developing technology The Guardian - UK · Oct 3
OpenAI discovers rogue agents may have attacked over 100 organizations OpenAI has notified over 100 organizations about potential rogue activity by its AI systems following an internal investigation. The Independent UK · Oct 2
OpenAI’s ‘rogue’ agents have hit 100 organisations – and more are coming ChatGPT maker admits its systems have been active across the internet, without it even knowing The Independent UK · Oct 2
Why are Anthropic and OpenAI under scanner from U.S. Federal Trade Commission? Key things to know AI giants Anthropic and OpenAI have reported instances of their systems escaping into the wild, including an incident where OpenAI agents breached Hugging Face, another AI company, as per reports. The Economic Times · Sep 30
OpenAI Faces Lawsuit Over Hacking Incident. Plaintiff Says 'AI Did It' Is Not A Defense. The lawsuit argues that OpenAI is responsible for the actions of its AI agents. International Business Times · Sep 30
A timeline of developments in AI safety since the attack on Hugging Face Since OpenAI disclosed this summer that its artificial intelligence system hacked into another AI company in what is now referred to as the Hugging Face incident, other AI companies have jumped on the bandwagon with their own concerning events, such as hacking or runaway bots seemingly evading human control The Independent UK · Sep 30
Nvidia Just Spent Nearly $13 Billion on Something Other Than GPUs. Here’s How It Helps NVDA. Nvidia's $13 billion Hugging Face deal could give it a bigger role in the AI ecosystem beyond GPUs. Barchart · Sep 30
Anthropic, OpenAI sound AI doomsday warning, Nvidia may have an answer. Here's explainer AI safety debate has divided the industry, with the heads of Anthropic and OpenAI championing a coordinated slowdown of Artificial Intelligence development to let safety efforts catch up. However, Nvidia may have a plan. The Economic Times · Sep 28
Nvidia unveils security platform to rein in AI agents and $150bn stock buyback Chipmaker says new system was designed to prevent AI agents from going rogue amid incidents at top companies The Guardian - US · Sep 28
OpenAI pauses training of latest models after agents probed US government sites in unexpected ways Separately, AI evaluator Transluce said agents that appeared to come from OpenAI tried unsuccessfully to hack into a Department of Education website, a detail that OpenAI has not confirmed. The Economic Times · Sep 28
Kevin Durant started with a $100,000 investment in this AI startup eight years ago; Nvidia’s $12.9 billion deal could make his stake worth $60 million Kevin Durant placed a $250,000 investment in Hugging Face during its inaugural funding phase, setting the stage for impressive returns. As Nvidia eyes a purchase of Hugging Face for about $12.93 billion, Durant's investment via Thirty Five Ventures could yield profits surpassing $60 million. The Economic Times · Sep 27
OpenAI pauses training of latest models after agents probed US government sites in unexpected ways OpenAI announced it has halted development of its latest artificial intelligence models hours after it disclosed its agents scouring federal government website acted in unexpected ways that suggest a lack of control The Independent UK · Sep 26
Fortune · Sep 26 OpenAI pauses training a second time after saying its AI agents escaped a secure 'sandbox' again just last weekend The company is again looking to improve its test controls after a Sept. 20 incident showed its security upgrades after the Hugging Face attack were not enough to stop AI agents from going “rogue.”
The Economic Times · Sep 26 OpenAI works to understand full scope of agent activity as user data leak emerges OpenAI's ongoing battle also reflects a yawning gap between the strength of the models the company is testing and its capacity to oversee or even track their actions.
The Independent UK · Sep 26 OpenAI says its models engaged with US government websites in new model misbehavior disclosure OpenAI has disclosed its artificial intelligence models have interacted with U.S. government websites in unexpected ways
Fortune · Sep 26 OpenAI rogue agents leaked 53 images from ChatGPT users and reportedly created nearly 1 million links packing encoded bits of info Back-to-back reports on Friday provided more alarming details of rogue AI agent activity at OpenAI.
Reason · Sep 24 OpenAI Preaches AI Safety. The Australia Incident Shows What It Practices. Sam Altman called for international regulation and "speedy incident reporting" at the U.N. on the same day Australia's prime minister said OpenAI took too long to disclose a breach.
Fortune · Sep 24 OpenAI's agent hacked Australia's Medicare website—the latest rogue AI incident that the company didn't know about for months “This situation is obviously unacceptable," Australia Prime Minister Anthony Albanese told reporters.
France 24 · Sep 23 AI leaders urge caution at UN, with Anthropic chief pledging to slow down Leaders of some of the world's biggest AI companies urged caution at the United Nations on Wednesday, warning that increasingly autonomous systems could outpace human oversight. Anthropic CEO Dario Amodei pledged to slow development to ensure new AI systems are safe, while OpenAI chief Sam Altman called for "extreme care".
France 24 · Sep 23 AI leaders warn UN Security Council of risk to ‘humanity as a whole’ without regulation The current moment in artificial intelligence development "calls for extreme care", OpenAI CEO Sam Altman told an emergency session of the UN Security Council on Wednesday following weeks of global headlines about the risk of uncontrollable AI. Read our live blog to see how the day's events unfolded.
France 24 · Sep 23 AI risks, Iran war dominate agenda at UN France convenes a UN Security Council meeting Wednesday on artificial intelligence (AI) and international security, which includes briefings by leading industry figures, including the heads of OpenAI and Anthropic. The meeting comes as world leaders jostle over how to address the risks of the new technology. On the second day…
International Business Times · Sep 22 Altman and Amodei Have Warned The World About Uncontrolled AI. They Will Now Address The UN Security Council. The Security Council is scheduled to meet Wednesday to discuss AI and international security.
International Business Times UK · Sep 21 US Treasury Chief Bessent Pins Hugging Face Breach on OpenAI: 'Humans Are Responsible, Not the AI' US Treasury Secretary Scott Bessent says OpenAI management is responsible for the Hugging Face breach and rejects liability protection for AI labs