However, these methods suffer from high computational cost. In this Workshop, we will give an overview of some selected transfer learning methods and review an example on how to use these models on a downstream task. Finally, we will discuss directions on how to use these models at scale.

During this workshop, participants will gain an understanding of some state-of-the-art transfer learning techniques in NLP (e.g., Bert, XLNet, etc). They will witness a hands-on example on how to finetune these models on a downstream task. Finally, participants will acknowledge the limitations of these models and gain an understanding on how to use them at scale.

• Basic Machine learning knowledge is preferred. However, we will make sure to make the workshop as inclusive as possible and accessible even for beginners.
• Own laptop