first
This commit is contained in:
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Attention
|
||||
|
||||
注意力机制是 Transformer 的核心。参见 [[Transformer]]。
|
||||
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Decoder
|
||||
|
||||
解码器组件。与 [[Transformer]] <!-- confidence: INFERRED --> 的解码端对应。
|
||||
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Encoder
|
||||
|
||||
编码器组件。属于 [[Transformer]] 架构的一部分。
|
||||
@@ -0,0 +1,7 @@
|
||||
---
|
||||
sources: ["gpt-series-overview.pdf"]
|
||||
---
|
||||
|
||||
# GPT
|
||||
|
||||
GPT 系列基于 [[Transformer]] <!-- confidence: AMBIGUOUS --> 的解码器架构。
|
||||
@@ -0,0 +1,13 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Transformer
|
||||
|
||||
Transformer 是一种基于自注意力机制的序列到序列模型架构。
|
||||
|
||||
## 核心组件
|
||||
|
||||
- [[Attention]] — 自注意力机制
|
||||
- [[Encoder]] — 编码器
|
||||
- [[Decoder]] — 解码器
|
||||
@@ -0,0 +1,9 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# Attention Is All You Need
|
||||
|
||||
原始论文提出了自注意力机制。
|
||||
|
||||
- [[Attention]] <!-- confidence: EXTRACTED -->
|
||||
@@ -0,0 +1,12 @@
|
||||
---
|
||||
sources: ["attention-is-all-you-need.pdf"]
|
||||
---
|
||||
|
||||
# 深度学习架构
|
||||
|
||||
本主题涵盖深度学习的核心架构组件。
|
||||
|
||||
- [[Transformer]]
|
||||
- [[Attention]]
|
||||
- [[Encoder]]
|
||||
- [[Decoder]]
|
||||
@@ -0,0 +1,9 @@
|
||||
---
|
||||
sources: ["gpt-series-overview.pdf"]
|
||||
---
|
||||
|
||||
# 微调技术
|
||||
|
||||
本主题涵盖模型微调相关技术。
|
||||
|
||||
- [[GPT]]
|
||||
Reference in New Issue
Block a user