Index
自然言語処理におけるアルゴリズム
深層学習を用いる手法を記す.
BERT / 2018
GPT / 2018 -
- GPT
- GPT-1 [2018 OpenAI]
- GPT-2 [2019 OpenAI]
- GPT-3 [2020 OpenAI]
- yhayato1320.hatenablog.com
ERNIE / 2019
- ERNIE: Enhanced Language Representation with Informative Entities
- [2019]
- v3
- arxiv.org
MT-DNN / 2019
- Multi-Task Deep Neural Networks for Natural Language Understanding
- [2019]
- arxiv.org
XLNet / 2019
- XLNet: Generalized Autoregressive Pretraining for Language Understanding
- [2019]
- arxiv.org
ELECTRA / 2020
- ELECTRA
- [2020 Google]
- yhayato1320.hatenablog.com
T5 / 2020
- T5
- [2020 Google]
- yhayato1320.hatenablog.com
Turing-NLG / 2020
- Turing-NLG
- [2020 Microsoft]
- www.microsoft.com
Meena / 2020
Blenderbot / 2020
MT-NLG / 2022
- Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
- [2022]
- arxiv.org
テクニック・工夫
Large Language Model / LLM
- Large Language Model / LLM
