Masked Attention

video locked
Enroll to watch

5 mins

This video explains "Masked" attention.

It is a useful technique to speed up LLM training.