Multi-Head Attention
الانتباه متعدد الرؤوس
Definition
Running several attention mechanisms in parallel with different projections and then combining their results.
Definition
Multi-head attention runs several attention functions in parallel on different learned projections and concatenates their outputs.
