research
SGCA
Sin-Gated Control Attention: separating attention retrieval from learned residual control.
sgcaattentiongating
Questions, controlled experiments, and open artifacts. An evolving archive of work on language models and their underlying structures.