research
Alethic
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
alethiclanguage-modelsresearch
Published work connected by this topic.
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
Experimental pretraining and SinGatedAttention exploration on constrained compute.
A supplied Python-data preparation record, separate from training progress.
The current context decision, separate from earlier long-context curricula.
Architecture targets, constrained compute, and infrastructure for an inspectable run.