1

Curious builder0 XP earned · 300 to level 2

0 daysFinish a lesson to begin

Badge collection0 of 6 unlocked

52 small wins to finish your pathNext lesson →

Transformer encoder and decoder quiz

Question 1 of 5

Layer normalization of the token cat = [2.0, 4.0, 6.0, 8.0] with γ = 1, β = 0 and ε = 1e-5. What is the first normalized value?

Back toLinear and softmax output layerFrom transformers to today's models →

Getting one wrong here is cheaper than getting it wrong in your own code.