DeepMind shows 70B Chinchilla outperforms much larger language models

DoomBench assesses “DeepMind shows 70B Chinchilla outperforms much larger language models” as evidence moving toward doom, with magnitude 58 and confidence 88 out of 100 in the capability gains category.

The DoomBench assessment of “DeepMind shows 70B Chinchilla outperforms much larger language models” is based on reporting from Google DeepMind and records the editorial rationale, source quality, attribution, and revision history.

DoomBench summarizes “DeepMind shows 70B Chinchilla outperforms much larger language models” as follows: DeepMind's compute-optimal scaling study trained Chinchilla on far more data and showed the 70-billion-parameter model...