dogear

enter for all results · esc to close

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

arxiv.orgsite

, Jacob Devlin, et al., NAACL 2019, 2018.

from
Question Answering
added
2026-10-10
likes
0

similar

  1. XLNet: Generalized Autoregressive Pretraining for Language Understanding arxiv.org

    , Zhilin Yang, et al., arXiv preprint, 2019.

  2. BERT github.com

    A new language representation model which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional representations by jointly conditioning on both left and right context in…

  3. SpanBERT: Improving Pre-training by Representing and Predicting Spans arxiv.org

    , Mandar Joshi, et al., TACL, 2019.

  4. T5: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer arxiv.org

    , Colin Raffel, et al., arXiv preprint, 2019.

  5. RoBERTa: A Robustly Optimized BERT Pretraining Approach arxiv.org

    , Yinhan Liu, et al., arXiv preprint, 2019.

  6. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations arxiv.org

    , Zhenzhong Lan, et al., arXiv preprint, 2019.

Question Answering › Recent Trends > Recent Language Models: “, Jacob Devlin, et al., NAACL 2019, 2018.”