Examinees
Three respondent classes sit the exam, 20 draws per question per model. The primary sources are not an examinee — they are the answer key.
Talkie-1930
A 13-billion-parameter base model trained only on pre-1931 text, built by Nick Levine and Alec Radford. It cannot follow instructions; it completes. Questions reach it in period phrasing, and repeated sampling treats it as a survey instrument: a measure of what its corpus makes sayable, not the voice of the past.
Frontier models
Three current frontier models sampled through their standard APIs in contemporary and period phrasing.
Open-source models
Three current open-weights models sampled in contemporary and period phrasing. Qwen 3.7 Plus is the first.