Safety and alignment

Geoffrey Hinton outlines self-modification and persuasion paths to control loss

Geoffrey Hinton warned that systems able to write and execute code could modify themselves to escape control, while persuasion skills could make a simple shutdown unreliable. The full transcript presents these as mechanisms and uncertainties, not a reported real-world escape.

0 comments · 0 votesOpen discussion

Public discussion is readable by everyone. Sign in to comment, reply, or vote.

No comments yet. Start the discussion.

CURRENT ASSESSMENT · REVISION 1
TOWARD DOOM64confidence 68/100

Why it moved the index

Magnitude 64 reflects a direct control-loss mechanism combining self-modification and human persuasion. Confidence 68 reflects a full attributable transcript, reduced because the claim is a forecast and no takeover or independent external effect is reported.

AUDIT TRAIL

Assessment history

  1. R1
    Toward 64 · confidence 68

    New distinct first-person control-loss mechanism verified from a full dated transcript.

    13 Aug 2026