Exploring the Limits of Language Modeling
Nice recursive models using word-level LSTMs on top of a character-level CNN using an overkill amount of GPU power.
- from
- Education
- added
- 2026-10-10
- likes
- 0
similar
-
Build a Large Language Model (From Scratch) manning.com
A guide to building your own working LLM, by Sebastian Raschka.
-
Training Compute-Optimal Large Language Models arxiv.org
Showed how model size and training data should scale together under a compute budget.
-
On the Effectiveness of Large Language Models in Domain-Specific Code Generation dl.acm.org
ACM Transactions on Software Engineering and Methodology, 2025. [All Versions]. Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite significant achievements, they rely on enormous training data to acquire a broad spectrum…
-
Scaling Laws for Neural Language Models arxiv.org
Explored relationships between model performance, data, and compute.
-
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 dx.doi.org
a frequently referenced but still relevant work concerning the roles, applications, and risks of language models.
-
Learning Task-General Representations with Generative Neuro-Symbolic Modeling arxiv.org
ICLR'21, 2021. [All Versions].
Education › Papers > Recurrent Neural Networks: “Nice recursive models using word-level LSTMs on top of a character-level CNN using an overkill amount of GPU power.”