Skip to content

Commit

Permalink
commit
Browse files Browse the repository at this point in the history
  • Loading branch information
jayarnim committed Jan 30, 2025
1 parent 12019e7 commit 104d7f4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion _posts/TextAnalytics/2024-08-07-Transformer.md
Original file line number Diff line number Diff line change
Expand Up @@ -136,7 +136,7 @@ $$\begin{aligned}

- $\mathcal{M}$ : Causal Mask(Upper-triangular mask)

- $$\text{Multi-Head}\left(\mathcal{H}^{(k)}_{1},\mathbf{Z},\mathbf{Z}\right)$$ : Multi-Head Cross Self Attention @ Decoder
- $$\text{Multi-Head}\left(\mathcal{H}^{(k)}_{1},\mathbf{Z},\mathbf{Z}\right)$$ : Multi-Head Cross Attention @ Decoder

- $$\mathbf{Z}$$ : Output of Encoder Module

Expand Down

0 comments on commit 104d7f4

Please sign in to comment.