Skip to content
This repository was archived by the owner on May 20, 2025. It is now read-only.

Commit e874a68

Browse files
Apply suggestions from code review
Co-authored-by: Rak Siva <[email protected]>
1 parent 6274176 commit e874a68

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/guides/python/llama-rag.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -76,7 +76,7 @@ We'll organize our project structure like so:
7676

7777
## Setting up our LLM
7878

79-
We'll define a `ModelParameters` class which will have parameters used throughout our application. By putting it in a class, it means it will lazily load the LLM, [embed model](https://docs.llamaindex.ai/en/stable/module_guides/models/embeddings/), and tokenizer so that it doesn't slow down other modules that don't require everything to be initialized. At this point we can also create a prompt template for prompts with our query engine. It will just sanitize some of the hallucinations so that if the model does not know an answer it won't pretend like it does. We'll also define two functions that will convert a prompt or message into the required Llama 3.2 format.
79+
We'll define a `ModelParameters` class which will have parameters used throughout our application. By putting it in a class, it means it will lazily load the LLM, [embed model](https://docs.llamaindex.ai/en/stable/module_guides/models/embeddings/), and tokenizer so that it doesn't slow down other modules that don't require everything to be initialized. At this point we can also create a prompt template for prompts with our query engine. It will sanitize some of the hallucinations so that if the model does not know an answer it won't pretend like it does. We'll also define two functions that will convert a prompt or message into the required Llama 3.2 format.
8080

8181
```python title:common/model_parameters.py
8282
import os
@@ -525,7 +525,7 @@ config:
525525
# We add more storage to the lambda function, so it can store the model
526526
ephemeral-storage: 1024
527527
```
528-
528+
<Note>When you set ephemeral storage above the default 512 MB, there may be additional charges based on the amount of storage and how long your function runs.</Note>
529529
We can then deploy using the following command:
530530
531531
```bash

0 commit comments

Comments
 (0)