2021-12-20 【深層学習】XLM #まとめ編 データサイエンス データサイエンス-深層学習 Transformer #まとめ編 yhayato1320.hatenablog.com Index Index XLM / 2019 XLM-RoBERTa / XLM-R / 2020 XLM-ProphetNet / 2020 XLM / 2019 XLM yhayato1320.hatenablog.com XLM-RoBERTa / XLM-R / 2020 RoBERTa yhayato1320.hatenablog.com Unsupervised Cross-lingual Representation Learning at Scale [2020 Facebook AI Research] arxiv.org XLM-ProphetNet / 2020 ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training [2020] ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training arxiv.org