Skip to content

Commit 76d7a19

Browse files
committed
Update wording in transformer notebook
1 parent cffaefc commit 76d7a19

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

workshops/transformer/transformer.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -337,7 +337,7 @@
337337
"cell_type": "markdown",
338338
"metadata": {},
339339
"source": [
340-
"#### **Step 2:** Feed tokens to model\n",
340+
"#### **Step 2:** Map tokens to logits\n",
341341
"\n",
342342
"\n",
343343
"After running a feed-forward pass on our model with an input with shape `[batch, seq_len]`, we get an output of shape `[batch, seq_len, vocab_size]`. The `[i, j, :]`-th element of our output is a vector of logits representing our prediction for the `j+1`-th token in the `i`-th sequence.\n"

workshops/transformer/transformer_hard.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -337,7 +337,7 @@
337337
"cell_type": "markdown",
338338
"metadata": {},
339339
"source": [
340-
"#### **Step 2:** Feed tokens to model\n",
340+
"#### **Step 2:** Map tokens to logits\n",
341341
"\n",
342342
"\n",
343343
"After running a feed-forward pass on our model with an input with shape `[batch, seq_len]`, we get an output of shape `[batch, seq_len, vocab_size]`. The `[i, j, :]`-th element of our output is a vector of logits representing our prediction for the `j+1`-th token in the `i`-th sequence.\n"

workshops/transformer/transformer_normal.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -337,7 +337,7 @@
337337
"cell_type": "markdown",
338338
"metadata": {},
339339
"source": [
340-
"#### **Step 2:** Feed tokens to model\n",
340+
"#### **Step 2:** Map tokens to logits\n",
341341
"\n",
342342
"\n",
343343
"After running a feed-forward pass on our model with an input with shape `[batch, seq_len]`, we get an output of shape `[batch, seq_len, vocab_size]`. The `[i, j, :]`-th element of our output is a vector of logits representing our prediction for the `j+1`-th token in the `i`-th sequence.\n"

0 commit comments

Comments
 (0)