research
Alethic
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
alethiclanguage-modelsresearch
Published work connected by this topic.
Language-model architecture research, from controlled small-model experiments to a planned ~1B Phase I.
Parameter-matched small language-model experiments with a sinusoidal attention gate.
Architecture targets, constrained compute, and infrastructure for an inspectable run.