BabyLM Challenge
BabyLM 2026: Sample-Efficient Pretraining Challenge
In conjunction with
Empirical Methods in Natural Language Processing 2026
October 24-29, 2026
HungExpo
Budapest, Hungary
A challenge on sample-efficient and cognitively plausible language model pretraining from small, developmentally realistic data. The constraint is the point: pretraining on roughly the amount of language a child hears, rather than on internet-scale corpora, tests whether current architectures are anywhere near as sample-efficient as human learners. Results consistently show they are not.
More workshops at Empirical Methods in Natural Language Processing 2026
- Analyzing and Interpreting Neural Networks for NLP — The leading interpretability venue in NLP, covering methods for understanding what language models learn and...
- Climate NLP — Applies NLP to climate change, from analyzing climate discourse to processing environmental and policy documents....
- Financial Technology and NLP — The ACL SIG-FinTech workshop on natural language processing for finance, from market analysis to financial...
- Multimodal Interaction in Face-to-Face Dialogue — Covers multimodal modeling of face-to-face conversation, including speech, gesture, and gaze. Face-to-face conversation carries meaning...
- Multilingual Representation Learning — Covers multilingual and cross-lingual representation learning, low-resource languages, and language transfer. Most of the world's...
- Natural Legal Language Processing — The venue for NLP applied to legal text, from contract analysis to legal reasoning and...
- NLP for Positive Impact — Focuses on NLP research aimed at social good, from health and education to sustainability and...
- Machine Translation — The long-running venue and shared-task competition for machine translation research, co-located with EMNLP. The shared...
Hotels near HungExpo
Danubius Hotel Arena
Ifjúság útja 1-3, Budapest, Hungary 1148
Expo Congress Hotel
Expo tér 2 - Albertirsai út 10., Budapest, Hungary 1101
Green Hotel Budapest
Kerepesi út 34, Budapest, Hungary 1148
Lion's Garden Hotel Budapest
Cházár András utca 4, Budapest, Hungary 1146
Three Corners Hotel Bristol
Kenyérmező utca 4, Budapest, Hungary 1081
Empirical Methods in Natural Language Processing 2025, Suzhou, China