Skip to content

Exploratory work analyzing loss landscapes of neural nets / steering between generalizations / phase transitions

Notifications You must be signed in to change notification settings

nrimsky/mlexperiments

Repository files navigation

Investigating generalization behavior in neural networks via Hessian analysis

Relevant posts

Codebase

  • mnist/ contains the code for the MNIST experiments (modified MNIST digit classification task with superimposed random patterns)
  • modular_addition/ contains the code for the modular addition experiments (addition of two numbers embedded as tokens modulo n)
  • results/ contains interesting results and artifacts from experiments
  • diagrams/ contains code and plots used to generate diagrams in the posts
  • misc/ contains code not directly related to the experiments or referenced in the posts, produced during the course of the project

Installing dependencies

python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

About

Exploratory work analyzing loss landscapes of neural nets / steering between generalizations / phase transitions

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published