OpenAI has quietly disbanded its catastrophic risk team (preparedness)
"It is kind of scary; there is an urgency now to get this right," one person close to OpenAI said.
Another said there was a "burbling sense of responsibility and dread that they aren't on the ball enough".
Jan Leike, who co-led the now-defunct "superalignment" team, resigned in 2024 citing his view that safety was taking a "back seat to shiny products".
The departures of Bakalar, Achiam and Johannes Heidecke, who all worked on safety, have added to internal unease.
Source: FT (ft. com/content/53082739-7714-4aae-9816-e55ab423cbee)
OpenAI's former Head of AGI Readiness (who quit so he could speak freely): "THE INDUSTRY IS NOT ON TOP OF F***ING ROGUE AIS BREAKING OUT OF SANDBOXES ALL THE TI...