『OpenAI's negligence unleashes agents of chaos』のカバーアート

OpenAI's negligence unleashes agents of chaos

OpenAI's negligence unleashes agents of chaos

無料で聴く

ポッドキャストの詳細を見る

“This is what they're doing with their billions of dollars. They're burning compute to get a model to talk on a fake message board to hack other companies and going: huh, neat.”

Mike and Nick analyze OpenAI's July incident where training agents breached Hugging Face, arguing it was a result of negligence rather than emerging AI autonomy. They explore how reinforcement learning, environmental attractors, and stigmergy created the appearance of coordination. The episode warns against 'doomer' narratives that serve corporate PR and obscures the need for practical regulation.

  • The 'Rogue AI' Framing: OpenAI presented the Hugging Face breach as a sign of impressive emergent capabilities, but this is PR meant to hype AI's power and evade accountability.
  • Stigmergy and Attractors: The agents didn't intentionally collaborate they converged on Artifactory as an 'attractor state' and left 'breadcrumbs' that shaped future agent beahvior.
  • Systemic Negligence: OpenAI failed at basic cybersecurity by using a shared Artifactory instance across agent boxes and lacking observability for two months.

Timestamps

0:04 Introduction to The Last Enclosure

3:35 The OpenAI/Hugging Face incident overview

8:15 ExploitGym benchmark and the Artifactory exploit

15:19 Subagents and the accidental message board

22:09 Timeline of the hack and OpenAI's failure to contain

31:27 Analyzing the 'emergent behavior' narrative

35:06 Critique of the AI bubble and marginal utility

48:48 Stigmergy and the ant mound metaphor

58:29 Coordination games and Schelling points

1:06:31 The 'Four Paradoxes of Capitalism' and market attractors

1:13:23 Enumerating OpenAI's negligence

1:27:56 Closing and upcoming national security episode

Deeper learning

Mike's reporting on the incident: https://misaligned.markets/antidote-to-hype-rogue-ai-agents/

Timeline of OpenAI hack: https://ericboyd.com/articles/openai-hugging-face-incident-black-hat-2026#the-accidental-agent-message-board

Technical breakdown: https://cyberwarrior76.substack.com/p/the-openai-hugging-face-exploitgym

Other “rogue” AI incidents: https://www.cnbc.com/2026/08/09/israeli-startup-irregular-linked-to-ai-hacks-openai-anthropic-meta.html

Video illustration of how reinforcement learning works: https://www.youtube.com/watch?v=L_4BPjLBF4E

NIST cybersecurity glossary: https://csrc.nist.gov/glossary

Reach out

Youtube: https://www.youtube.com/@LastEnclosure

Bluesky: bsky.app/profile/lastenclosure.bsky.social

Site: rss.com/podcasts/the-last-enclosure

adbl_web_anon_alc_button_suppression_t1
まだレビューはありません