NLP Highlights of 2020 by Sebastian Ruder: 1. Scaling up—and | Data Science by ODS.ai 🦜

NLP Highlights of 2020

by Sebastian Ruder:

1. Scaling up—and down
2. Retrieval augmentation
3. Few-shot learning
4. Contrastive learning
5. Evaluation beyond accuracy
6. Practical concerns of large
7. LMs
8. Multilinguality
9. Image Transformers
10. ML for science
11. Reinforcement learning

https://ruder.io/research-highlights-2020/