Skip to content

Commit 834f23a

Browse files
Fix typo in softmax explanation in transformers.jl (#20)
There was an additional "the".
1 parent 4546a02 commit 834f23a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

Lectures/transformers.jl

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -325,7 +325,7 @@ md"## Key-Value (KV) cache"
325325
# ╔═╡ 9a8eef1b-27c0-4d57-a389-53708ade9058
326326
md"""
327327
Let ``\hat{Y}_{i}`` be the intermediate output of ``i \in \{1, \ldots, N\}``.
328-
The the columns of the matrix ``\text{softmax}(C^\top \hat{Y}_i)`` (column-wise softmax) can be thought as intermediate probabilities that we denote ``\hat{p}_i``:
328+
The columns of the matrix ``\text{softmax}(C^\top \hat{Y}_i)`` (column-wise softmax) can be thought as intermediate probabilities that we denote ``\hat{p}_i``:
329329
```math
330330
(\hat{p}_i(x_{-n_\text{ctx}+1} | x_{-n_\text{ctx}}), \ldots, \hat{p}_i(x_{-1} | x_{-2}, \ldots, x_{-n_\text{ctx}}), \hat{p}_i(x_0 | x_{-1}, \ldots, x_{-n_\text{ctx}}))
331331
```

0 commit comments

Comments
 (0)