Skip to content

Commit dceba1c

Browse files
authored
Update 3-language-models.md
1 parent 710306a commit dceba1c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

learn-pr/wwl-data-ai/fundamentals-generative-ai/includes/3-language-models.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,7 @@ Simplifying the example sentence, you can provide the following input to an RNN:
5353

5454
:::image type="content" source="../media/vincent-tokenized.png" alt-text="Diagram showing the sentence tokenized to present the most important words in a sentence as individual tokens.":::
5555

56-
The RNN takes each token as an input, processes it, and update the hidden state with a memory of that token. When the next token is processed as new input, the hidden state from the previous step is updated.
56+
The RNN takes each token as an input, processes it, and updates the hidden state with a memory of that token. When the next token is processed as new input, the hidden state from the previous step is updated.
5757

5858
Finally, the last token is presented as input to the model, namely the `[MASK]` token. Indicating that there's information missing and the model needs to predict its value. The RNN then uses the hidden state to predict that the output should be something like `Starry Night`
5959

0 commit comments

Comments
 (0)