DOOMBENCH.COM
Safety and alignment

Jacob Steinhardt maps concrete pathways to losing control of advanced AI

Jacob Steinhardt argued that opaque, agent-like, rapidly changing AI could amplify cyberattacks, unemployment, mis-optimization, and loss of human sovereignty, while outlining value learning, verification, transparency, and strategic planning as near-term research priorities.

0 comments · 0 votesOpen discussion

Public discussion is readable by everyone. Sign in to comment, reply, or vote.

No comments yet. Start the discussion.

Send detailed or private feedback →
CURRENT ASSESSMENT · REVISION 1
TOWARD DOOM40confidence 72/100

Why it moved the index

The essay contributes a specific early synthesis of control difficulty: open-ended agency, rapid capability change, opacity, weakly supervised value learning, cyber misuse, labor disruption, and diminished human sovereignty. Magnitude is moderate and confidence is bounded because these are reasoned mechanisms and forecasts rather than a completed loss-of-control event.

Assessment history

  1. R1
    Toward 40 · confidence 72

    Initial historical inclusion from a fully dated first-person essay with distinct control-risk reasoning.

    17 Aug 2026

Share this page

DoomBench social sharing card for Jacob Steinhardt maps concrete pathways to losing control of advanced AI.

  1. DoomBench assesses “Jacob Steinhardt maps concrete pathways to losing control of advanced AI” as evidence moving toward doom, with magnitude 40 and confidence 72 out of 100 in the safety and alignment category.

  2. The DoomBench assessment of “Jacob Steinhardt maps concrete pathways to losing control of advanced AI” is based on reporting from Jacob Steinhardt and records the editorial rationale, source quality, attribution, and revision history.

  3. DoomBench summarizes “Jacob Steinhardt maps concrete pathways to losing control of advanced AI” as follows: Jacob Steinhardt argued that opaque, agent-like, rapidly changing AI could amplify cyberattacks, unemployment, mis-optimization,...

    https://www.doombench.com/news/jacob-steinhardt-maps-concrete-pathways-to-losing-control-of-advanced-ai-2015-06-24