Skip to content

Commit

Permalink
commit
Browse files Browse the repository at this point in the history
  • Loading branch information
jayarnim committed Feb 1, 2025
1 parent 097eeeb commit 1fbe809
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion _posts/TextAnalytics/2024-08-09-GPT.md
Original file line number Diff line number Diff line change
Expand Up @@ -137,4 +137,10 @@ $$\begin{aligned}
\end{aligned}$$

- $\mathbf{W}^{(k)}_{1} \in \mathbb{R}^{M \times 4d}$ : **Dimension Expansion** to four times the Dimension of the Embedding Vector
- $\mathbf{W}^{(k)}_{2} \in \mathbb{R}^{M \times d}$ : **Dimension Reduction** to Embedding Vector Dimension
- $\mathbf{W}^{(k)}_{2} \in \mathbb{R}^{M \times d}$ : **Dimension Reduction** to Embedding Vector Dimension

-----

### Reference

- https://wikidocs.net/184363

0 comments on commit 1fbe809

Please sign in to comment.