You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[ UPDATE ] - v1.2.2
- Revised ReadMe file to reflect the update in model configurations to `llama-3-sonar-large-32k-chat`, `llama-3-sonar-small-32k-chat`, `llama-3-sonar-large-32k-online`, and `llama-3-sonar-small-32k-online`, removing references to older `sonar-medium-chat` and `sonar-medium-online` models. This changes also removes the `mistral` and `codellama` implementations as they are no longer supported by Perplexity Labs.
Copy file name to clipboardExpand all lines: README.md
+8-13Lines changed: 8 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -26,7 +26,7 @@
26
26
</p>
27
27
28
28
## Overview
29
-
The Perplexity AI Toolkit makes it easy to use Perplexity Labs' `Sonar` language models and a suit of open-source models like `LLama-3`, `Mistral`,`Mixtral`, and `CodeLlama` for creating chatbots, generating text, and searching the web (in real-time). It's designed for everyone, from beginners to experienced developers, allowing quick addition of AI features to projects with simple commands. While it offers simplicity and lightweight integration, it doesn't compromise on power; experienced developers can access the full suite of advanced options available via the API, ensuring robust customization and control. This toolkit is perfect for those looking to efficiently tap into advanced AI without getting bogged down in technical details, yet it still provides the depth needed for complex project requirements.
29
+
The Perplexity AI Toolkit makes it easy to use Perplexity Labs' `Sonar` language models (built on top of LLama-3), `LLama-3` and`Mixtral`, for creating chatbots, generating text, and searching the web (in real-time). It's designed for everyone, from beginners to experienced developers, allowing quick addition of AI features to projects with simple commands. While it offers simplicity and lightweight integration, it doesn't compromise on power; experienced developers can access the full suite of advanced options available via the API, ensuring robust customization and control. This toolkit is perfect for those looking to efficiently tap into advanced AI without getting bogged down in technical details, yet it still provides the depth needed for complex project requirements.
30
30
31
31
## Key Features
32
32
-**Search Functionality**: Search online (in real-time) with the help of AI.
@@ -154,7 +154,7 @@ Search().run(query="What is today's date?")
154
154
| Online search query |`-q`, `--query`| --query "What is today's date?"| query="What is today's date?"|
155
155
| User prompt |`-p`, `--prompt`| --prompt "How many stars are there in our galaxy?"| prompt="How many stars are there in our galaxy?"|
156
156
| API key for authentication |`-a`, `--api_key`| --api_key your_api_key | api_key="your_api_key"|
157
-
| Model name |`-m`, `--model`| --model "sonar-medium-chat"| model="sonar-medium-online"|
157
+
| Model name |`-m`, `--model`| --model "llama-3-sonar-large-32k-online"| model="llama-3-sonar-large-32k-online"|
@@ -187,12 +187,7 @@ Where possible, Perplexity tries to match the Hugging Face implementation.
187
187
|---------------------------|----------------|
188
188
| `llama-3-8b-instruct` | 8192 |
189
189
| `llama-3-70b-instruct` | 8192 |
190
-
| `codellama-70b-instruct` | 16384 |
191
-
| `mistral-7b-instruct` [1] | 16384 |
192
190
| `mixtral-8x7b-instruct` | 16384 |
193
-
| `mixtral-8x22b-instruct` | 16384 |
194
-
195
-
> [1] This model refers to the v0.2 release of `mistral-7b-instruct`.
196
191
197
192
### Online LLMs
198
193
Search mode is limited to 'online' models, such as `sonar-small-online` and `sonar-medium-online`. For these online LLMs, Perplexity recommends refraining from using system prompts.
0 commit comments