first
This commit is contained in:
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Attention
|
||||
|
||||
注意力机制是 Transformer 的核心。参见 [[Transformer]]。
|
||||
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Decoder
|
||||
|
||||
解码器组件。与 [[Transformer]] <!-- confidence: INFERRED --> 的解码端对应。
|
||||
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Encoder
|
||||
|
||||
编码器组件。属于 [[Transformer]] 架构的一部分。
|
||||
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["gpt-series-overview.pdf"]
|
||||
---
|
||||
|
||||
# GPT
|
||||
|
||||
GPT 系列基于 [[Transformer]] <!-- confidence: AMBIGUOUS --> 的解码器架构。
|
||||
@@ -0,0 +1,13 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Transformer
|
||||
|
||||
Transformer 是一种基于自注意力机制的序列到序列模型架构。
|
||||
|
||||
## 核心组件
|
||||
|
||||
- [[Attention]] — 自注意力机制
|
||||
- [[Encoder]] — 编码器
|
||||
- [[Decoder]] — 解码器
|
||||
Reference in New Issue
Block a user