Paper Understanding
Papers
Concepts
Formulas
KO
EN
ln_post
Post-LN
P
o
s
t
L
N
:
y
=
L
N
(
x
+
S
u
b
l
a
y
e
r
(
x
)
)
\mathrm{PostLN}:\; y = \mathrm{LN}(x + \mathrm{Sublayer}(x))
PostLN
:
y
=
LN
(
x
+
Sublayer
(
x
))
Post-LN
수식 상세 →
단계별 설명
1
원본 Transformer 배치. 잔차 합 뒤에 LN.
관련 논문
layernorm
transformer