Machine learning and natural language processing
7. Deep neural networks for NLP
Lectures slides (all materials, refs, etc. provided inline):
Pa164 lecture 07
QUESTIONS AND TASKS:
Why we need LSTM. Describe a task where LSTM are useful
What are transformers? How do they differ from "vanilla" recurrent neural networks?
Describe the basic intuition behind gradient descent and back-propagation