Jonathan Lys
Toggle navigation
about
projects
publications
CV
notes
(current)
Random notes on deep learning, tools, and methods.
Pre-training Small LMs
Pre-train small LMs with a limited compute budget.
8 min read · July 16, 2025
2025
