Merge pull request #365 from Portkey-AI/may-changelog

May changelog changes

Author: siddharthsambharia-portkey

changelog/2025/may.mdx

@@ -4,9 +4,9 @@ title: "May"
 
 **May-king it production ready✨**
 
-Infra shouldn’t slow you down. In May, we shipped the kind of upgrades that help you move fast into productiion and stay in control—whether you're scaling agents, securing AI behavior, or managing costs across teams.
+In May, we shipped the kind of upgrades that help you move your AI Agents fast into productiion and stay in control — whether you're scaling, securing AI behavior, or bringing new models to your apps.
 
-From deeper integrations with agent frameworks to support for newer models Portkey keeps evolving as the AI infra layer teams can rely on. We also shipped observability upgrades, expanded our provider network, and added tighter controls for cost, access, and security.
+We launched deep integrations with agent frameworks like PydanticAI and OpenAI Agents SDK, added enterprise-grade controls to Claude Code, made it simpler to call a remote MCP server simpler and much more!
 
 Here’s everything new this month:
 
@@ -15,67 +15,55 @@ Here’s everything new this month:
 
 | Area | Key Updates |
 | :-- | :-- |
-| **AI agent infrastructure** | • PydanticAI integration for modular agent development<br/>• OpenAI Agents SDK support with monitoring, guardrails, and cost tracking<br/>• Strands Agents integration with observability, retries, and load balancing<br/>• Remote MCP server support via Responses API<br/>• Arize Phoenix tracing integration for unified agent observability |
-| **Platform** | • Deep integration into Azure AI ecosystem (OpenAI, Foundry, APIM, Marketplace)<br/>• Support for Claude Code with rate limits, observability, and access control<br/>• AI coding assistant integrations: Cline, Roo Code<br/>• Multimodal embedding support via Vertex AI (text, image, video)<br/>• Multi-label support for prompt versions<br/>• OpenAI Computer Use Tool routing and observability<br/>• Full support for `GET`, `PUT`, and `DELETE` HTTP methods<br/>• OTel analytics export to your existing observability stack |
-| **Improvements** | • Token cost tracking for gpt-image-1<br/>• Ping messages removed from streamed responses<br/>• Resizing metadata columns in logs |
-| **New models & providers** | • Claude 4 now live<br/>• PDF support for Claude via Anthropic and Bedrock<br/>• OpenAI’s Computer Use Tool supported via Responses API<br/>• Grok 3 and Grok 3 Mini on Azure<br/>• Gemini 2.5 Thinking Mode in Prompt Playground<br/>• Extended thinking for Claude 3.7 and Claude 4<br/>• Mistral supports function calling<br/>• WorkersAI supports image generation<br/>• Lepton AI, Nscale now integrated<br/>• Tool calling enabled for Mistral and OpenRouter<br/>• MIME type support for Vertex and Google<br/>• PDF support via Anthropic and Bedrock |
-| **Guardrails** | • Prompt Security guardrails for injection detection and sensitive data protection<br/>• JWT validator input guardrail<br/>• PANW Prisma AIRS plugin for real-time prompt/response risk blocking<br/>• Model whitelist guardrail for org/environment/request-level control |
-| **Documentation** | • Guardrail documentation moved under “Integrations”<br/>• New solution pages for AWS Bedrock and GovCloud<br/>• Cookbook: OpenAI Computer Use tool <br/>• Cookbook: Optimizing Prompts using LLama Prompt Ops |
+| **AI agent infrastructure** | • Integration with PydanticAI, OpenAI Agents SDK, Strands Agents integration<br/>• Remote MCP server support via Responses API<br/>• Arize Phoenix tracing integration|
+| **AI tools** | • Integration with Claude Code, Cline, Roo Code<br/>
+| **Platform** | • Deep integration into Azure AI ecosystem<br/>• Multi-label support for prompt versions<br/>• Full support for `GET`, `PUT`, and `DELETE` HTTP methods<br/>• OTel analytics export |
+| **New models & providers** | • Claude 4 now live<br/>• Grok 3 and Grok 3 Mini on Azure<br/>• Lepton AI, Nscale now integrated<br/>• PDF support for Claude via Anthropic and Bedrock<br/>• WorkersAI supports image generation<br/>• Tool calling enabled for Mistral and OpenRouter<br/>• MIME type support for Vertex and Google<br/> |
+| **Guardrails** | • Prompt Security guardrails for injection detection and sensitive data protection<br/>• JWT validator input guardrail<br/>• PANW Prisma AIRS plugin for real-time prompt/response risk blocking<br/>• Model whitelist guardrail for org/environment/request-level control<br/> 
 ---
 
-## AI agent infrastructure
+## AI Agent Infrastructure
 AI agent frameworks are helping teams prototype faster, but taking agents to production requires real infrastructure. Portkey integrates with leading frameworks to bring interoperability, observability, reliability, and cost management to your agent workflows.
 
-**PydanticAI**
+<CardGroup cols={3}>
 
-Portkey now integrates PydanticAI, a Python framework that brings FastAPI-like ergonomics to building AI agents. With Portkey, you can:
-
-- Build modular, testable agents with a clean developer experience.
-- Route all agent calls through Portkey for observability and debugging.
-- Add retries, fallbacks, guardrails, and cost tracking without extra infra
-
-See how it's done [here](https://portkey.ai/docs/integrations/agents/pydantic-ai#pydantic-ai)
-
-**OpenAI Agents SDK**
-
-Portkey integrates with the OpenAI Agents SDK to help teams ship production-grade agents with built-in planning, memory, and tool use. You can now:
-
-- Monitor and debug each step of the agent’s reasoning and tool use.
-- Automatically track usage and cost for each agent call.
-- Apply guardrails to both agent input and output.
-- Scale agent-based workflows across environments with versioned control
+<Card
+  title="PydanticAI"
+  href="https://portkey.ai/docs/integrations/agents/pydantic-ai#pydantic-ai">
+  PydanticAI is a Python framework that brings FastAPI-like ergonomics to building AI agents.<br/><br/>
+</Card>
 
-Explore the integration [here](https://portkey.ai/docs/integrations/agents/openai-agents)
+<Card
+  title="OpenAI Agents SDK"
+  href="https://portkey.ai/docs/integrations/agents/openai-agents">
+  OpenAI Agents SDK helps teams ship production-grade agents with built-in planning, memory, and tool use.<br/><br/>
+</Card>
 
-**Strands Agents**
+<Card
+  title="Strands Agents"
+  href="https://portkey.ai/docs/integrations/agents/strands">
+  Strands Agents is a lightweight agent framework built by AWS to simplify agent development.<br/><br/>
+ <br/>
+</Card>
 
-Strands Agents is a lightweight agent framework built by AWS to simplify agent development.
+</CardGroup>
 
-Portkey now integrates seamlessly with Strands Agents to make them production-ready. With this integration, you get:
+**Tracing Integrations: Arize AI**
 
-- Full observability into agent steps, tool calls, and interactions
-- Built-in reliability through fallbacks, retries, and load balancing
-- Cost tracking and spend optimization
+For teams consolidating observability into Arize, you can now view Portkey’s logs directly into Arize Phoenix to get unified trace views across your LLM workflows.
 
-See how it's done [here](https://portkey.ai/docs/integrations/agents/strands)
 
-**Support for remote MCP servers!**
+## Remote MCP servers
 
 Portkey now supports calling a remote MCP server that is maintained by developers and organizations across the internet that expose these tools to MCP clients via the Responses API
-Read more about the integration [here](https://portkey.ai/docs/product/ai-gateway/remote-mcp)
+Read more about the integration [here](https://portkey.ai/docs/product/ai-gateway/remote-mcp).
 
-**Tracing Integrations: Arize AI**
-
-For teams consolidating observability into Arize, you can now view Portkey’s logs directly into Arize Phoenix to get unified trace views across your LLM workflows.
+## Azure AI ecosystem
 
-## Platform
-
-**Azure AI ecosystem**
+More than half of Fortune 500 companies use Azure OpenAI. But building GenAI apps in the enterprise is still messy, cost attribution, routing logic, usage tracking, model evaluation... all scattered.
 <Frame>
 <img width="700" src="/images/changelog/azure-integration.jpeg" />
 </Frame>
-More than half of Fortune 500 companies use Azure OpenAI. But building GenAI apps in the enterprise is still messy, cost attribution, routing logic, usage tracking, model evaluation... all scattered.
-
 With Portkey’s deep integration into the Azure AI ecosystem (OpenAI, Foundry, APIM, Marketplace), teams can now build, scale, and govern GenAI apps without leaving their existing cloud setup.
 
 
@@ -84,41 +72,49 @@ Our customers are vouching for it!
 <img width="700" src="/images/changelog/testimonial3.png" />
 </Frame>
 
-Working with Azure? Read more [here](https://portkey.ai/for/azure)
-
-**Claude Code**
 
-Bring visibility, governance, and control to Anthropic’s agentic coding assistant with Portkey.
+## Portkey for AI Tools
 
-With this integration, you can:
+<CardGroup cols={2}>
 
-- Avoid system overload by enforcing rate limits
-- Monitor usage by tagging and filtering with metadata (e.g., user ID, workspace)
-- Debug and trace issues faster with detailed logs for every interaction
-- Share controlled, secure access by issuing virtual API keys per user
-- Use Claude code in your existing AWS Bedrock or Vertex AI setup, with granular governance and access control
+<Card
+  title="Claude Code"
+  href="https://portkey.ai/docs/integrations/libraries/claude-code">
+  Bring enterprise-grade visibility, governance, and access control to Claude Code.
+</Card>
 
-Start using Portkey with [Claude Code](https://portkey.ai/docs/integrations/libraries/claude-code)
+<Card
+  title="Cline"
+  href="https://portkey.ai/docs/integrations/libraries/cline">
+  Supercharge your AI-powered terminal with cost tracking, access controls, and observability.
+</Card>
 
-**AI coding assistants**
+<Card
+  title="Roo Code"
+  href="https://portkey.ai/docs/integrations/libraries/roo-code">
+  Add security, compliance, and real-time analytics to your code assistant workflows.
+</Card>
 
-Plug Portkey into [Cline](https://portkey.ai/docs/integrations/libraries/cline) or [Roo Code](https://portkey.ai/docs/integrations/libraries/roo-code) and enable:
+<Card
+  title="Goose"
+  href="https://portkey.ai/docs/integrations/libraries/goose">
+ Add essential enterprise controls to Goose's powerful autonomous coding capabilities
+</Card>
 
-- Access to the latest models from OpenAI, Anthropic, Mistral, and more
-- Full observability—log every prompt, tool use, and response with metadata
-- Access control with scoped API keys and JWT-based authentication
-- Built-in governance and cost tracking per user, project, or team
+</CardGroup>
 
-**Multilmodal embeddings**
+## Multilmodal embeddings 
 
 Portkey now supports embedding APIs from Vertex AI for text, image, and video—across multiple languages.
 This unlocks the ability to:
-- Build cross-language search and retrieval
+- Build multimodal search and retrieval
 - Power multimodal RAG pipelines
 - Track, route, and optimize embedding usage at scale
 
 Read more about the implementation [here](https://portkey.ai/docs/integrations/llms/vertex-ai/embeddings)
 
+## Platform
+
 **Multi-label support for prompts**
 
 <Frame>
@@ -127,16 +123,6 @@ Read more about the implementation [here](https://portkey.ai/docs/integrations/l
 
 You can now assign multiple labels to a single prompt version, making it easy to promote a version across environments like staging and production.
 
-**OpenAI Computer Use Tool**
-
-Build production-grade browser automation with enterprise-level controls using Portkey and:
-
-- Route and monitor Computer Use API calls
-- Build a complete Playwright-based browser automation solution
-- Add observability, logging, and cost controls with Portkey
-
-Explore the implementation [here](https://portkey.ai/docs/guides/use-cases/openai-computer-use)
-
 **Gateway to any API**
 
 Portkey now supports `GET`, `PUT`, and `DELETE` HTTP methods in addition to `POST`, allowing you to route requests to any external or self-hosted provider endpoint. This means you can connect to custom APIs directly through Portkey with full observability for every call.
@@ -150,71 +136,58 @@ You can now export Portkey analytics to any OpenTelemetry (OTel)-compatible coll
 - Ping messages are removed from streamed responses.
 - Resizing metadata columns in logs
 
-## New Models and Providers
-
-- Claude 4 is now live on Portkey.
-- PDFs can be sent to Claude via Anthropic and Bedrock.
-- OpenAI’s Computer Use Tool works via the Responses API.
-- Grok 3 and Grok 3 Mini are available on Azure.
-- Gemini 2.5 supports Thinking Mode in Prompt Playground.
-- Extended thinking added for Claude 3.7 and Claude 4.
-- Mistral now supports function calling.
-- Image generation is now available on WorkersAI.
-- Lepton AI is now integrated with Portkey.
-- Nscale models can be accessed via Portkey.
-- Tool calling is live for Mistral and OpenRouter.
-- MIME types are now handled for Vertex and Google.
-- PDFs are supported via Anthropic and Bedrock routes.
+**This is what keeps us going!**
+<Frame>
+<img src="/images/changelog/testimonial1.png" width="100%"/>
+</Frame>
 
+## New Models & Providers
+
+<div style={{ display: "flex", gap: "2rem", flexWrap: "wrap" }}>
+  <div style={{ flex: 1, minWidth: 300 }}>
+    <ul>
+        <b>New additions</b>
+      <li><b>Claude 4</b> is now live for advanced reasoning and coding.</li>
+      <li><b>Grok 3 & Grok 3 Mini</b> are available on Azure</li>
+      <li><b>Lepton AI</b> is now live</li>
+      <li><b>Nscale Models</b> can now be accessed through Portkey.</li>
+    </ul>
+  </div>
+  <div style={{ flex: 1, minWidth: 300 }}>
+    <ul>
+    <b>Updates</b>
+      <li><b>PDF Support for Claude</b> via Anthropic and Bedrock.</li>
+      <li><b>Gemini 2.5 Thinking Mode</b> is now supported in Prompt Playground.</li>
+      <li><b>Extended Thinking</b> is available for Claude 3.7 and Claude 4.</li>
+      <li>Image generation now supported on WorkersAI</li>
+      <li><b>Tool Calling and Function Calling for Mistral</b> is now live.</li>
+      <li><b>MIME Type</b> is now supported for Vertex AI</li>
+    </ul>
+  </div>
+</div>
 
 ## Guardrails
 
 - **Prompt Security guardrails**: Integrate with Prompt Security to detect prompt injection and prevent sensitive data exposure in both prompts and responses.
 
 - **JWT validator guardrail**: Added as an input guardrail to validate incoming JWT tokens before requests are sent to the LLM.
 
-- **PANW Prisma AIRS Plugin**:Portkey now integrates with Palo Alto Networks' AIRS (AI Runtime Security) to enforce guardrails that block risky prompts or model responses based on real-time security analysis.
-
-- **Model whitelist guardrail**:Restrict or deny specific models at the org, environment, or request level using a flexible whitelist/blacklist guardrail.
-
-## Documentation and Guides
-
-**Optimizing Prompts using LLama Prompt Ops**
-
-Need to try out or switch to the latest Llama models? There's an easier way to do it.
-Llama Prompt Ops transforms prompts that work well with other LLMs into ones that are optimized specifically for Llama models. This helps you get better performance and more reliable results without having to rewrite everything yourself.
+- **PANW Prisma AIRS Plugin**: Portkey now integrates with Palo Alto Networks' AIRS (AI Runtime Security) to enforce guardrails that block risky prompts or model responses based on real-time security analysis.
 
-If you work in customer support, we've put together a helpful guide that will show you how to build a system that analyzes support messages for urgency and sentiment, and helps categorize them properly.
+- **Model whitelist guardrail**: Restrict or deny specific models at the org, environment, or request level using a flexible whitelist/blacklist guardrail.
 
-Check it out [here](https://portkey.ai/docs/guides/prompts/llama-prompts)
-
-**OpenAI’s Computer Use tool**
-
-Build production-grade browser automation with enterprise-level controls. Our latest cookbook shows you how to:
-
-- Route and monitor Computer Use API calls
-- Build a complete Playwright-based browser automation solution
-- Add observability, logging, and cost controls with Portkey
-
-[Explore OpenAI Computer use tool](https://portkey.ai/docs/guides/use-cases/openai-computer-use)
-
-**Other updates**
-
-- Guardrail documentation moved under “Integrations”.
-- Expanded guides for agent frameworks like CrewAI and LangGraph
-
-
-## Customer love!
-
-From powering reliable provider failovers at Hedy to equipping AI policy analysts, Portkey is becoming the trusted backbone for builders!
-<Frame>
-<img src="/images/changelog/testimonial1.png" width="100%"/>
-</Frame>
+**No frills. No hype. Just serious safety**
 <Frame>
-<img src="/images/changelog/lions-testimonial.png" width="100%"/>
+<img src="/images/changelog/lions-teat.png" width="100%"/>
 </Frame>
 
-### Community Contributors
+## Resources
+- Cookbook: [Optimizing Prompts with LLama Prompt Ops](https://portkey.ai/docs/guides/prompts/llama-prompts)
+- Cookbook: [OpenAI Computer Use Tool](https://portkey.ai/docs/guides/llms/openai-computer-use-tool)
+- Guardrail documentation is now located under “Integrations”.
+- Expanded guides for agent frameworks, including CrewAI and LangGraph.
+
+## Community Contributors
 
 A special thanks to our community contributors this month:
 - [unsync](https://github.com/unsync)