AI 용어집
인공지능 완전 사전
162
카테고리
2,032
하위 카테고리
23,060
용어
용어
Add & Norm Layer
Residual normalization layer applied after the attention mechanism, combining the attention output with the original input (residual connection) before normalizing the sum.
용어
Linear Projection in Attention
Linear transformation (multiplication by a weight matrix) applied to input embeddings to generate Query, Key, and Value vectors, allowing the model to learn attention-specific representation spaces.
🔍