Pre-training Small LMs
Pre-train small LMs with a limited compute budget.
Blog posts
2025
2024
Site Launch - Accepted paper at EUSIPCO 2024
Announcement: first paper accepted as an oral at EUSIPCO
Pre-train small LMs with a limited compute budget.
Announcement: first paper accepted as an oral at EUSIPCO