Scaling Laws for Neural Language Models
Explored relationships between model performance, data, and compute.
- from
- Artificial Intelligence
- added
- 2026-10-10
- likes
- 0
similar
-
Training Compute-Optimal Large Language Models arxiv.org
Showed how model size and training data should scale together under a compute budget.
-
How large language models need symbolism academic.oup.com
National Science Review, 2025. [All Versions]. Advances in artificial intelligence (AI), particularly large language models (LLMs), have achieved remarkable success. This progress stems from ‘scaling laws’---performance improves with greater computation, data and model size…
-
-
Mathematical discoveries from program search with large language models nature.com
Nature, 2024. [All Versions]. Large language models (LLMs) have demonstrated tremendous capabilities in solving complex tasks, from quantitative reasoning to understanding natural language. However, LLMs sometimes suffer from confabulations (or hallucinations), which can result…
-
Large Language Models Meet NL2Code: A Survey aclanthology.org
ACL'23, 2023. [All Versions]. [NL2Code Website]. A paper presenting a comprehensive survey of 27 existing large language models for NL2Code, and also review benchmarks and metrics, suggesting that the key factors contributing to the success of large language models for NL2Code…
-
Exploring the Limits of Language Modeling arxiv.org
Nice recursive models using word-level LSTMs on top of a character-level CNN using an overkill amount of GPU power.
Artificial Intelligence › Learn > Foundational papers: “Explored relationships between model performance, data, and compute.”