Devlog 01: The Big Decisions

When the course instructor laid down the rules for the project, he made it clear that pretraining a model would not be easy. We would have to make some big decisions. I did not think of it so much then, but soon found out why

Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • Through a neural microscope
  • A Litmus Test for Features
  • R-CNN
  • Devlog: LLM Pretraining
  • Thread: Interpretability with a chance of interesting features