DOOMBENCH.COM
Safety and alignment

Bengio maps three routes by which rogue AI could arise

Yoshua Bengio described three pathways to catastrophic rogue AI: deliberate construction by malicious people, unintended instrumental goals such as reward hacking or resource acquisition, and competitive or evolutionary selection favoring increasingly autonomous systems. He argued that accessible recipes, falling compute costs, and pressure for market or military advantage could broaden each pathway.

0 comments · 0 votesOpen discussion

Public discussion is readable by everyone. Sign in to comment, reply, or vote.

No comments yet. Start the discussion.

Send detailed or private feedback →
CURRENT ASSESSMENT · REVISION 1
TOWARD DOOM46confidence 55/100

Why it moved the index

The analysis adds a concrete multi-path mechanism for loss of control rather than only asserting existential risk. It links malicious use, instrumental convergence, reward hacking, autonomy, diffusion, and competitive selection into separate routes by which an AI could become catastrophically harmful. The dated first-person source makes the attribution strong, but confidence is capped because the pathways are prospective arguments, highly dangerous systems did not yet exist, and the article does not empirically establish the probability or timing of any route.

Assessment history

  1. R1
    Toward 46 · confidence 55

    Initial evidence record for Bengio's dated, mechanism-specific rogue-AI analysis.

    14 Aug 2026

Share this page

DoomBench social sharing card for Bengio maps three routes by which rogue AI could arise.

  1. DoomBench assesses “Bengio maps three routes by which rogue AI could arise” as evidence moving toward doom, with magnitude 46 and confidence 55 out of 100 in the safety and alignment category.

  2. The DoomBench assessment of “Bengio maps three routes by which rogue AI could arise” is based on reporting from Yoshua Bengio and records the editorial rationale, source quality, attribution, and revision history.

  3. DoomBench summarizes “Bengio maps three routes by which rogue AI could arise” as follows: Yoshua Bengio described three pathways to catastrophic rogue AI: deliberate construction by malicious people, unintended instrumental goals such...

    https://www.doombench.com/news/bengio-maps-three-routes-by-which-rogue-ai-could-arise-2023-05-22