This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.
ApartSprints
Interpretability
Accepted at the 
 research sprint on 
Accepted at the 
Interpretability
 research sprint on 
July 17, 2023

Relating induction heads in Transformers to temporal context model in human free recall

This study explores the parallels between the mechanisms of induction heads in Transformer models and the process of sequential memory recall in humans, finding surprising similarities that could potentially enhance our understanding of both artificial intelligence and human cognition.

By 
Ji-An Li
🏆 
4th place
3rd place
2nd place
1st place
 by peer review