I Trained a Language Model. Then I Built a Brain Scanner and Looked Inside It.

A DIY sparse autoencoder tutorial for DIY tiny language models : superposition hypothesis, feature visualization, and activation steering… Continue reading on Medium »