Maximum amount of activity points for this week: 2
Applied Machine Learning
Transformers and Attention
Attention is all you need
This is the original paper if you would be curious. We don't expect you to read it and understand it, but it might be interesting for you to just have a look inside.
Alternative reading with pictures:
Hugging Face models to play with:
https://huggingface.co/roberta-base
https://huggingface.co/albert-base-v2
https://huggingface.co/finiteautomata/bertweet-base-sentiment-analysis?
https://huggingface.co/m-newhauser/distilbert-political-tweets?