mechanistic-interpretability

500M Parameters, 11 Patterns — GitHub Project Pries Open AI's Black Box

A GitHub project flips large models inside-out: 500M-parameter models may have just 11 independent patterns — a breakthrough for interpretability.