ended3월 22일· 1 sources
[Learning notes] reading "Attention is all you need" paper
[학습 노트] "Attention Is All You Need" 논문 읽기
Why it matters
This post contains personal learning notes from reading the "Attention Is All You Need" paper, explaining core concepts like encoder-decoder architecture, attention mechanisms, and the Transformer model's advantages including parallelization and reduced training time. It highlights the paper's breakthrough results on WMT 2014 benchmarks, where a single Transformer model surpassed previous ensemble-based state-of-the-art scores on English-German and English-French translation tasks by significant BLEU margins.
1
Sources
+0
24h
—
Growth
172d
Active
TransformerAttention mechanismBLEUWMT 2014Encoder-DecoderEnsembles