Self Governing Neural Networks (SGNN): the Projection Layer
With this, you can use words in your deep learning models without training nor loading embeddings.
- from
- Education
- added
- 2026-10-10
- likes
- 0
similar
-
Self-Governing Neural Networks for On-Device Short Text Classification aclweb.org
This paper is the sequel to the ProjectionNet just above. The SGNN is elaborated on the ProjectionNet, and the optimizations are detailed more in-depth (also see my attempt to reproduce the paper in code and watch the talks' recording).
-
ProjectionNet: Learning Efficient On-Device Deep Networks Using Neural Projections arxiv.org
Replace word embeddings by word projections in your deep neural networks, which doesn't require a pre-extracted dictionnary nor storing embedding matrices.
-
-
Embeddings github.com
-
neural-go github.com
Multilayer perceptron network implemented in Go, with training via backpropagation.
-
Education › Practical Resources > Librairies and Implementations: “With this, you can use words in your deep learning models without training nor loading embeddings.”