Robots in Disguise: Fundamental AI Reading Group

Public repo for The Alan Turing Institute's reading group on fundamental AI research.

If you're based at the Turing, follow #robots-in-disguise on the Turing Slack for the most recent updates.

To see all the slides and reading materials for previous sessions, see the archive.

Note that this originated from the Research Engineering Team's reading group on Transformers.

Overview

The group meets every week on Mondays at 11-12. Everyone is welcome to join! If you have any questions email Ryan Chan, Fede Nanni or Giulia Occhini and remember to go through our Code of Conduct before joining.

Please get in touch if you would like to give a talk (either about your research or a topic you think is relevant to the reading group) add suggestions and emoji preferences to the list of proposed topics on HackMD!

Upcoming Schedule

Date	Topic	Room	Lead
28/10/24	No Language Left Behind (NLLB) Technical Report Overview	David Blackwell	Giulia Occhini, Ryan Chan
04/11/24	Invited Talk: Ethnographic Approaches to AI Evaluations	Ursula Franklin	Jonas Kgomo
11/11/24	Scaling laws of neural networks	David Blackwell	Edmund Dable-Heath
18/11/24	Application of foundation models in time series tasks	David Blackwell	Gholamali Aminian
25/11/24	TBC	David Blackwell	TBC
02/12/24	Mechanistic Interpretability III	David Blackwell	Ryan Chan
09/12/24	TBC	David Blackwell	TBC
16/12/24	TBC	David Blackwell	TBC

Material for sessions

28/10/24

No Language Left Behind (NLLB)

• No Language Left Behind: Scaling Human-Centered Machine Translation (Report)
• Scaling neural machine translation to 200 languages (Nature paper)
• No Language Left Behind (NLLB) project

02/12/24

Mechanistic Interpretability III

• Toy Models of Superposition
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learning
• Scaling and evaluating sparse autoencoders
• Sparse Autoencoders Find Highly Interpretable Features in Language Models