diff --git a/images/supported-llm/bytez.jpeg b/images/supported-llm/bytez.jpeg new file mode 100644 index 00000000..3749c3b5 Binary files /dev/null and b/images/supported-llm/bytez.jpeg differ diff --git a/integrations/llms.mdx b/integrations/llms.mdx index 25a95670..1b370f5c 100644 --- a/integrations/llms.mdx +++ b/integrations/llms.mdx @@ -51,6 +51,10 @@ description: "Portkey connects with all major LLM providers and orchestration fr + + Bytez + + Dashscope diff --git a/integrations/llms/bytez.mdx b/integrations/llms/bytez.mdx new file mode 100644 index 00000000..80837af5 --- /dev/null +++ b/integrations/llms/bytez.mdx @@ -0,0 +1,93 @@ +--- +title: "Bytez" +--- + +Portkey provides a robust and secure gateway to facilitate the integration of various models into your apps. + +With Portkey, you can take advantage of features like fast AI gateway access, observability, prompt management, and more, all while ensuring the secure management of your LLM API keys through a [virtual key](/product/ai-gateway/virtual-keys) system. + +Provider Slug. `bytez` + +Portkey supports all chat models on [Bytez](https://www.bytez.com)! + +That also means multi-modal models are supported 🔥 + +Tasks supported: `chat`, `image-text-to-text`, `audio-text-to-text`, `video-text-to-text` + +## Portkey SDK Integration with Bytez Models + +Portkey provides a consistent API to interact with models from various providers. To integrate Bytez with Portkey: + +### 1\. Install the Portkey SDK + + + + ```sh + npm install --save portkey-ai + ``` + + + + ```sh + pip install portkey-ai + ``` + + + + + +### 2\. Initialize Portkey with the Virtual Key + +To use Bytez with Portkey, [get your API key from here](https://bytez.com/api), then add it to Portkey to create the virtual key. + + + + ```js + import Portkey from 'portkey-ai' + + const portkey = new Portkey({ + apiKey: "PORTKEY_API_KEY", // Defaults to process.env["PORTKEY_API_KEY"] + provider:"@BYTEZ_PROVIDER" // Your Virtual Key + }) + ``` + + + ```python + from portkey_ai import Portkey + + portkey = Portkey( + api_key="PORTKEY_API_KEY", # Defaults to os.env("PORTKEY_API_KEY") + provider="@BYTEZ_PROVIDER" # Your Virtual Key + ) + ``` + + + + +### **3\. Invoke Chat Completions with** Bytez + +You can use the Portkey instance now to send requests to Bytez API. + + + + ```js + const chatCompletion = await portkey.chat.completions.create({ + messages: [{ role: 'user', content: 'Say this is a test' }], + model: 'google/gemma-3-4b-it', + }); + + console.log(chatCompletion.choices); + ``` + + + ```python + completion = portkey.chat.completions.create( + messages= [{ "role": 'user', "content": 'Say this is a test' }], + model= 'google/gemma-3-4b-it' + ) + + print(completion) + ``` + + +