This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.
Interpretability Hackathon
Accepted at the 
Interpretability Hackathon
 research sprint on 
November 15, 2022

How to find the minimum of a list - Transformer Edition

We train a 1L transformer to find the minimum value in a list of 50 values. We figure out how it works.

Ole, Stefan, Ayham, Devesh, Joe
4th place
3rd place
2nd place
1st place
 by peer review