research
Alethic-151M
Experimental pretraining and SinGatedAttention exploration on constrained compute.
alethictrainingmodels
Questions, controlled experiments, and open artifacts. An evolving archive of work on language models and their underlying structures.