research
Alethic
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
alethiclanguage-modelsresearch
Published work connected by this topic.
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
The SGCA research question, residual update, and requirements for a fair comparison.
The current context decision, separate from earlier long-context curricula.
A careful reading of parameter-matched Tiny Shakespeare results and their limits.