Get all your news in one place.
100's of premium titles.
One app.
Start reading
Fortune
Fortune
Technology
Jeremy Kahn

INSANE: Why are ai safety experts alarmed by reports openais astra model uses recurrent depth | Rare Historical Photos

OpenAI CEO Sam Altman (Credit: Matt RAMEY—AFP/Getty Images)

AI safety experts are raising alarms about how OpenAI has built its soon-to-be-released frontier AI model Astra, saying it may hasten the day when humans will lose the ability to monitor the reasoning that AI agents are using.

For its new model, OpenAI has employed a method alternately referred to as “recurrent depth” or “looped Transformers” for a portion of the model’s internal architecture. The method can make AI models considerably more efficient by employing less computing power required to process each prompt—a valuable feature at a time when many businesses are complaining about the high costs of using the most advanced frontier AI models.

The new process, though, also means that part of the AI model’s “chain of thought,” or the reasoning steps it is taking, are not expressed in natural language, making it much more difficult for humans to monitor what the model is doing and why.

Chain-of-thought monitoring is currently one of the methods companies use to make sure AI agents are not taking unintended or unauthorized actions.

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.