Skip to content

Commit 6650ee7

Browse files
authored
Update README.md
[ UPDATE ] - v1.2.2 - Revised ReadMe file to reflect the update in model configurations to `llama-3-sonar-large-32k-chat`, `llama-3-sonar-small-32k-chat`, `llama-3-sonar-large-32k-online`, and `llama-3-sonar-small-32k-online`, removing references to older `sonar-medium-chat` and `sonar-medium-online` models. This changes also removes the `mistral` and `codellama` implementations as they are no longer supported by Perplexity Labs.
1 parent 3eb4f02 commit 6650ee7

File tree

1 file changed

+8
-13
lines changed

1 file changed

+8
-13
lines changed

README.md

Lines changed: 8 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@
2626
</p>
2727

2828
## Overview
29-
The Perplexity AI Toolkit makes it easy to use Perplexity Labs' `Sonar` language models and a suit of open-source models like `LLama-3`, `Mistral`, `Mixtral`, and `CodeLlama` for creating chatbots, generating text, and searching the web (in real-time). It's designed for everyone, from beginners to experienced developers, allowing quick addition of AI features to projects with simple commands. While it offers simplicity and lightweight integration, it doesn't compromise on power; experienced developers can access the full suite of advanced options available via the API, ensuring robust customization and control. This toolkit is perfect for those looking to efficiently tap into advanced AI without getting bogged down in technical details, yet it still provides the depth needed for complex project requirements.
29+
The Perplexity AI Toolkit makes it easy to use Perplexity Labs' `Sonar` language models (built on top of LLama-3), `LLama-3` and `Mixtral`, for creating chatbots, generating text, and searching the web (in real-time). It's designed for everyone, from beginners to experienced developers, allowing quick addition of AI features to projects with simple commands. While it offers simplicity and lightweight integration, it doesn't compromise on power; experienced developers can access the full suite of advanced options available via the API, ensuring robust customization and control. This toolkit is perfect for those looking to efficiently tap into advanced AI without getting bogged down in technical details, yet it still provides the depth needed for complex project requirements.
3030

3131
## Key Features
3232
- **Search Functionality**: Search online (in real-time) with the help of AI.
@@ -154,7 +154,7 @@ Search().run(query="What is today's date?")
154154
| Online search query | `-q`, `--query` | --query "What is today's date?" | query="What is today's date?" |
155155
| User prompt | `-p`, `--prompt` | --prompt "How many stars are there in our galaxy?" | prompt="How many stars are there in our galaxy?" |
156156
| API key for authentication | `-a`, `--api_key` | --api_key your_api_key | api_key="your_api_key" |
157-
| Model name | `-m`, `--model` | --model "sonar-medium-chat" | model="sonar-medium-online" |
157+
| Model name | `-m`, `--model` | --model "llama-3-sonar-large-32k-online" | model="llama-3-sonar-large-32k-online" |
158158
| Enable streaming mode | `-st`, `--stream` | --stream | stream=True |
159159
| System prompt (instructions) | `-sp`, `--system_prompt` | --system_prompt "Be precise and concise." | system_prompt="Be precise and concise." |
160160
| Maximum tokens to generate | `-mt`, `--max_tokens` | --max_tokens 100 | max_tokens=100 |
@@ -172,12 +172,12 @@ Perplexity uniquely offers both native models and a selection of large, open-sou
172172
173173
### Perplexity Models
174174
175-
| **Model** | **Max Tokens** |
176-
|-----------------------|----------------|
177-
| `sonar-small-chat` | 16384 |
178-
| `sonar-small-online` | 12000 |
179-
| `sonar-medium-chat` | 16384 |
180-
| `sonar-medium-online` | 12000 |
175+
| **Model** | **Max Tokens** |
176+
|----------------------------------|----------------|
177+
| `llama-3-sonar-small-32k-chat` | 32768 |
178+
| `llama-3-sonar-small-32k-online` | 28000 |
179+
| `llama-3-sonar-large-32k-chat` | 32768 |
180+
| `llama-3-sonar-large-32k-online` | 28000 |
181181
182182
### Open-Source Models
183183
@@ -187,12 +187,7 @@ Where possible, Perplexity tries to match the Hugging Face implementation.
187187
|---------------------------|----------------|
188188
| `llama-3-8b-instruct` | 8192 |
189189
| `llama-3-70b-instruct` | 8192 |
190-
| `codellama-70b-instruct` | 16384 |
191-
| `mistral-7b-instruct` [1] | 16384 |
192190
| `mixtral-8x7b-instruct` | 16384 |
193-
| `mixtral-8x22b-instruct` | 16384 |
194-
195-
> [1] This model refers to the v0.2 release of `mistral-7b-instruct`.
196191
197192
### Online LLMs
198193
Search mode is limited to 'online' models, such as `sonar-small-online` and `sonar-medium-online`. For these online LLMs, Perplexity recommends refraining from using system prompts.

0 commit comments

Comments
 (0)