Modal catalog migration #597
Open
Mintlify / Mintlify Deployment
succeeded
Nov 29, 2025 in 46s
Deployment Succeeded
Your changes are now live at https://portkey-docs-modal-catalog-migration.mintlify.app!
Details
Verified update permissions
Fetching and validating config file...
Successfully validated docs.json
Fetching .mintignore file...
No .mintignore file found
file too large - skipping: images/autogen/autogen-1.gif
file too large - skipping: images/autogen/autogen-2.gif
file too large - skipping: images/autogen/autogen-3.gif
file too large - skipping: images/autogen/autogen-4.gif
file too large - skipping: images/autogen/autogen-5.gif
file too large - skipping: images/changelog/model-catalog.mp4
file too large - skipping: images/libraries/dspy-traces.gif
file too large - skipping: images/product/ai-gateway/ai-32.gif
file too large - skipping: images/product/ai-gateway/saved-filters.gif
file too large - skipping: images/product/metadata-logs.gif
file too large - skipping: images/product/saved-filters.gif
Fetched all file paths
Fetched 1 OpenApi file(s):
- https://raw.githubusercontent.com/Portkey-AI/openapi/refs/heads/master/openapi.yaml
Fetched 0 AsyncApi file(s)
Skipped OpenAPI navigation generation
Skipped AsyncAPI navigation generation
Successfully updated API reference metadata.
No stale files found
Updating targeted paths:
guides/getting-started/function-calling.mdx
guides/getting-started/image-generation.mdx
guides/getting-started/llama-3-on-groq.mdx
guides/getting-started/return-repeat-requests-from-cache.mdx
guides/getting-started/tackling-rate-limiting.mdx
guides/integrations/groq.mdx
guides/integrations/langchain.mdx
guides/integrations/mixtral-8x22b.mdx
guides/prompts/build-a-chatbot-using-portkeys-prompt-templates.mdx
guides/use-cases/few-shot-prompting.mdx
Successfully updated deployment
LaTeX configuring is unchanged
Successfully saved config
No stale tracked assets found
Updating navigation...
Navigation updated
Skipped search indexing.
Successfully deleted stale OpenAPI document(s)
Successfully deleted stale AsyncAPI document(s)
Cached valid paths
Starting page revalidation...
Revalidating all pages...
Revalidating paths:
.cursor/commands/document-a-release
GROUP_2_MIGRATION_PLAN
GROUP_3_MIGRATION_PLAN
GROUP_5_MIGRATION_PLAN
MASTER_MIGRATION_GUIDE
README
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-latency-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cache-hit-rate-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-cost-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-error-rate-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-errors-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-per-ai-models-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-feedback-score-distribution-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-latency-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-requests-per-user-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-rescued-requests-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-status-code-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-tokens-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-unique-status-code-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-users-data
api-reference/admin-api/control-plane/analytics/graphs-time-series-data/get-weighted-feedback-data
api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-metadata-grouped-data
api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-model-grouped-data
api-reference/admin-api/control-plane/analytics/groups-paginated-data/get-user-grouped-data
api-reference/admin-api/control-plane/analytics/summary/get-all-cache-data
api-reference/admin-api/control-plane/api-keys/create-api-key
api-reference/admin-api/control-plane/api-keys/delete-an-api-key
api-reference/admin-api/control-plane/api-keys/list-api-keys
api-reference/admin-api/control-plane/api-keys/retrieve-an-api-key
api-reference/admin-api/control-plane/api-keys/update-api-key
api-reference/admin-api/control-plane/audit-logs/list-audit-logs
api-reference/admin-api/control-plane/configs/create-config
api-reference/admin-api/control-plane/configs/delete-config
api-reference/admin-api/control-plane/configs/list-config-versions
api-reference/admin-api/control-plane/configs/list-configs
api-reference/admin-api/control-plane/configs/retrieve-config
api-reference/admin-api/control-plane/configs/update-config
api-reference/admin-api/control-plane/guardrails/create-guardrail
api-reference/admin-api/control-plane/guardrails/delete-guardrail
api-reference/admin-api/control-plane/guardrails/list-guardrails
api-reference/admin-api/control-plane/guardrails/retrieve-guardrail
api-reference/admin-api/control-plane/guardrails/update-guardrail
api-reference/admin-api/control-plane/integrations/create-integration
api-reference/admin-api/control-plane/integrations/delete-integration
api-reference/admin-api/control-plane/integrations/list-integrations
api-reference/admin-api/control-plane/integrations/models/delete-custom-model
api-reference/admin-api/control-plane/integrations/models/list-model-access
api-reference/admin-api/control-plane/integrations/models/update-model-access
api-reference/admin-api/control-plane/integrations/retrieve-integration
api-reference/admin-api/control-plane/integrations/update-integration
api-reference/admin-api/control-plane/integrations/workspaces/list-workspace-access
api-reference/admin-api/control-plane/integrations/workspaces/update-workspace-access
api-reference/admin-api/control-plane/policies/rate-limits/create-rate-limits-policy
api-reference/admin-api/control-plane/policies/rate-limits/delete-rate-limits-policy
api-reference/admin-api/control-plane/policies/rate-limits/list-rate-limits-policy
api-reference/admin-api/control-plane/policies/rate-limits/retrieve-rate-limits-policy
api-reference/admin-api/control-plane/policies/rate-limits/update-rate-limits-policy
api-reference/admin-api/control-plane/policies/usage-limits/create-usage-limits-policy
api-reference/admin-api/control-plane/policies/usage-limits/delete-usage-limits-policy
api-reference/admin-api/control-plane/policies/usage-limits/list-usage-limits-policy
api-reference/admin-api/control-plane/policies/usage-limits/retrieve-usage-limits-policy
api-reference/admin-api/control-plane/policies/usage-limits/update-usage-limits-policy
api-reference/admin-api/control-plane/prompts/collections/create-collection
api-reference/admin-api/control-plane/prompts/collections/delete-collection
api-reference/admin-api/control-plane/prompts/collections/list-collections
api-reference/admin-api/control-plane/prompts/collections/retrieve-collection
api-reference/admin-api/control-plane/prompts/collections/update-collection
api-reference/admin-api/control-plane/prompts/create-prompt
api-reference/admin-api/control-plane/prompts/delete-prompt
api-reference/admin-api/control-plane/prompts/labels/create-label
api-reference/admin-api/control-plane/prompts/labels/delete-label
api-reference/admin-api/control-plane/prompts/labels/list-labels
api-reference/admin-api/control-plane/prompts/labels/retrieve-label
api-reference/admin-api/control-plane/prompts/labels/update-label
api-reference/admin-api/control-plane/prompts/list-prompt-versions
api-reference/admin-api/control-plane/prompts/list-prompts
api-reference/admin-api/control-plane/prompts/partials/create-partial
api-reference/admin-api/control-plane/prompts/partials/delete-partial
api-reference/admin-api/control-plane/prompts/partials/list-partial-versions
api-reference/admin-api/control-plane/prompts/partials/list-partials
api-reference/admin-api/control-plane/prompts/partials/publish-partial
api-reference/admin-api/control-plane/prompts/partials/retrieve-partial
api-reference/admin-api/control-plane/prompts/partials/update-partial
api-reference/admin-api/control-plane/prompts/publish-prompt
api-reference/admin-api/control-plane/prompts/retrieve-prompt
api-reference/admin-api/control-plane/prompts/retrieve-prompt-version
api-reference/admin-api/control-plane/prompts/update-prompt
api-reference/admin-api/control-plane/prompts/update-prompt-version
api-reference/admin-api/control-plane/providers/create-provider
api-reference/admin-api/control-plane/providers/delete-provider
api-reference/admin-api/control-plane/providers/list-providers
api-reference/admin-api/control-plane/providers/retrieve-provider
api-reference/admin-api/control-plane/providers/update-provider
api-reference/admin-api/control-plane/user-invites/delete-a-user-invite
api-reference/admin-api/control-plane/user-invites/invite-a-user
api-reference/admin-api/control-plane/user-invites/resend-a-user-invite
api-reference/admin-api/control-plane/user-invites/retrieve-all-user-invites
api-reference/admin-api/control-plane/user-invites/retrieve-an-invite
api-reference/admin-api/control-plane/users/remove-a-user
api-reference/admin-api/control-plane/users/retrieve-a-user
api-reference/admin-api/control-plane/users/retrieve-all-users
api-reference/admin-api/control-plane/users/update-a-user
api-reference/admin-api/control-plane/virtual-keys/create-virtual-key
api-reference/admin-api/control-plane/virtual-keys/delete-virtual-key
api-reference/admin-api/control-plane/virtual-keys/list-virtual-keys
api-reference/admin-api/control-plane/virtual-keys/retrieve-virtual-key
api-reference/admin-api/control-plane/virtual-keys/update-virtual-key
api-reference/admin-api/control-plane/workspace-members/add-a-workspace-member
api-reference/admin-api/control-plane/workspace-members/remove-workspace-member
api-reference/admin-api/control-plane/workspace-members/retrieve-a-workspace-member
api-reference/admin-api/control-plane/workspace-members/retrieve-all-workspace-members
api-reference/admin-api/control-plane/workspace-members/update-workspace-member
api-reference/admin-api/control-plane/workspaces/create-workspace
api-reference/admin-api/control-plane/workspaces/delete-a-workspace
api-reference/admin-api/control-plane/workspaces/retrieve-a-workspace
api-reference/admin-api/control-plane/workspaces/retrieve-all-workspaces
api-reference/admin-api/control-plane/workspaces/update-workspace
api-reference/admin-api/data-plane/feedback
api-reference/admin-api/data-plane/feedback/create-feedback
api-reference/admin-api/data-plane/feedback/update-feedback
api-reference/admin-api/data-plane/guardrails
api-reference/admin-api/data-plane/logs/insert-a-log
api-reference/admin-api/data-plane/logs/log-exports-beta/cancel-a-log-export
api-reference/admin-api/data-plane/logs/log-exports-beta/create-a-log-export
api-reference/admin-api/data-plane/logs/log-exports-beta/download-a-log-export
api-reference/admin-api/data-plane/logs/log-exports-beta/list-log-exports
api-reference/admin-api/data-plane/logs/log-exports-beta/retrieve-a-log-export
api-reference/admin-api/data-plane/logs/log-exports-beta/start-a-log-export
api-reference/admin-api/data-plane/logs/log-exports-beta/update-a-log-export
api-reference/admin-api/error
api-reference/admin-api/introduction
api-reference/admin-api/open-api-specification
api-reference/inference-api/anthropic-transform
api-reference/inference-api/assistants-api/assistants/create-assistant
api-reference/inference-api/assistants-api/assistants/delete-assistant
api-reference/inference-api/assistants-api/assistants/list-assistants
api-reference/inference-api/assistants-api/assistants/modify-assistant
api-reference/inference-api/assistants-api/assistants/retrieve-assistant
api-reference/inference-api/assistants-api/messages/create-message
api-reference/inference-api/assistants-api/messages/delete-message
api-reference/inference-api/assistants-api/messages/list-messages
api-reference/inference-api/assistants-api/messages/modify-message
api-reference/inference-api/assistants-api/messages/retrieve-message
api-reference/inference-api/assistants-api/run-steps/list-run-steps
api-reference/inference-api/assistants-api/run-steps/retrieve-run-steps
api-reference/inference-api/assistants-api/runs/cancel-run
api-reference/inference-api/assistants-api/runs/create-run
api-reference/inference-api/assistants-api/runs/create-thread-and-run
api-reference/inference-api/assistants-api/runs/list-runs
api-reference/inference-api/assistants-api/runs/modify-run
api-reference/inference-api/assistants-api/runs/retrieve-run
api-reference/inference-api/assistants-api/runs/submit-tool-outputs-to-run
api-reference/inference-api/assistants-api/threads/create-thread
api-reference/inference-api/assistants-api/threads/delete-thread
api-reference/inference-api/assistants-api/threads/modify-thread
api-reference/inference-api/assistants-api/threads/retrieve-thread
api-reference/inference-api/audio/create-speech
api-reference/inference-api/audio/create-transcription
api-reference/inference-api/audio/create-translation
api-reference/inference-api/authentication
api-reference/inference-api/batch/cancel-batch
api-reference/inference-api/batch/create-batch
api-reference/inference-api/batch/list-batch
api-reference/inference-api/batch/retrieve-batch
api-reference/inference-api/chat
api-reference/inference-api/completions
api-reference/inference-api/config-object
api-reference/inference-api/embeddings
api-reference/inference-api/error-codes
api-reference/inference-api/files/delete-file
api-reference/inference-api/files/list-files
api-reference/inference-api/files/retrieve-file
api-reference/inference-api/files/retrieve-file-content
api-reference/inference-api/files/upload-file
api-reference/inference-api/fine-tuning/cancel-fine-tuning
api-reference/inference-api/fine-tuning/create-fine-tuning-job
api-reference/inference-api/fine-tuning/list-fine-tuning-checkpoints
api-reference/inference-api/fine-tuning/list-fine-tuning-events
api-reference/inference-api/fine-tuning/list-fine-tuning-jobs
api-reference/inference-api/fine-tuning/retrieve-fine-tuning-job
api-reference/inference-api/gateway-for-other-apis
api-reference/inference-api/headers
api-reference/inference-api/images/create-image
api-reference/inference-api/images/create-image-edit
api-reference/inference-api/images/create-image-variation
api-reference/inference-api/introduction
api-reference/inference-api/models/models
api-reference/inference-api/moderations
api-reference/inference-api/open-api-specification
api-reference/inference-api/prompts/prompt-completion
api-reference/inference-api/prompts/render
api-reference/inference-api/response-schema
api-reference/inference-api/responses/delete-response
api-reference/inference-api/responses/responses
api-reference/inference-api/responses/retrieve-inputs
api-reference/inference-api/responses/retrieve-response
api-reference/inference-api/supported-providers
api-reference/sdk/c-sharp
api-reference/sdk/list
api-reference/sdk/node
api-reference/sdk/python
api-reference/sdk/rust
changelog/2024/dec
changelog/2024/nov
changelog/2024/oct
changelog/2025/apr
changelog/2025/august
changelog/2025/feb
changelog/2025/jan
changelog/2025/july
changelog/2025/june
changelog/2025/mar
changelog/2025/may
changelog/2025/october
changelog/2025/september
changelog/backend
changelog/data-service
changelog/enterprise
changelog/frontend
changelog/helm-chart
changelog/node-sdk-changelog
changelog/office-hour
changelog/open-source
changelog/product
changelog/python-sdk-changelog
enterprise/hybrid
enterprise/hybrid2
enterprise/poc
enterprise/pricing
enterprise/security
enterprise/support
guides/getting-started
guides/getting-started/101-on-portkey-s-gateway-configs
guides/getting-started/a-b-test-prompts-and-models
guides/getting-started/function-calling
guides/getting-started/getting-started-with-ai-gateway
guides/getting-started/image-generation
guides/getting-started/llama-3-on-groq
guides/getting-started/return-repeat-requests-from-cache
guides/getting-started/tackling-rate-limiting
guides/getting-started/trigger-automatic-retries-on-llm-failures
guides/integrations
guides/integrations/anyscale
guides/integrations/arize-portkey
guides/integrations/deepinfra
guides/integrations/groq
guides/integrations/introduction-to-gpt-4o
guides/integrations/langchain
guides/integrations/llama-3-on-portkey-+-together-ai
guides/integrations/mistral
guides/integrations/mixtral-8x22b
guides/integrations/openwebui-to-portkey
guides/integrations/segmind
guides/integrations/vercel-ai
guides/prompts
guides/prompts/build-a-chatbot-using-portkeys-prompt-templates
guides/prompts/llama-prompts
guides/prompts/llm-as-a-judge
guides/prompts/ultimate-ai-sdr
guides/ted-ai-hack-24
guides/use-cases
guides/use-cases/build-an-article-suggestion-app-with-supabase-pgvector-and-portkey
guides/use-cases/comparing-top10-lmsys-models-with-portkey
guides/use-cases/deepseek-r1
guides/use-cases/emotions-with-gpt-4o
guides/use-cases/enforcing-json-schema-with-anyscale-and-together
guides/use-cases/enterprise-ready-unified-api
guides/use-cases/fallback-from-sdxl-to-dall-e-3
guides/use-cases/fallbacks-test
guides/use-cases/few-shot-prompting
guides/use-cases/guardrail-pii-use-case
guides/use-cases/how-to-use-openai-sdk-with-portkey-prompt-templates
guides/use-cases/librechat-web-search
guides/use-cases/multi-tenant-ai-feature
guides/use-cases/openai-computer-use
guides/use-cases/run-batch-evals
guides/use-cases/run-portkey-on-prompts-from-langchain-hub
guides/use-cases/setting-up-resilient-load-balancers-with-failure-mitigating-fallbacks
guides/use-cases/setup-openai-greater-than-azure-openai-fallback
guides/use-cases/smart-fallback-with-model-optimized-prompts
guides/use-cases/track-costs-using-metadata
guides/whitepapers/optimizing-llm-costs/advanced-strategies
guides/whitepapers/optimizing-llm-costs/architectural-considerations
guides/whitepapers/optimizing-llm-costs/conclusion-and-key-takeaways
guides/whitepapers/optimizing-llm-costs/cost-effective-development
guides/whitepapers/optimizing-llm-costs/executive-summary
guides/whitepapers/optimizing-llm-costs/frugalgpt-techniques
guides/whitepapers/optimizing-llm-costs/future-trends
guides/whitepapers/optimizing-llm-costs/introduction
guides/whitepapers/optimizing-llm-costs/llm-cost-drivers
guides/whitepapers/optimizing-llm-costs/operational-best-practices
guides/whitepapers/optimizing-llm-costs/user-education
integrations
integrations/agents
integrations/agents/agno-ai
integrations/agents/autogen
integrations/agents/bring-your-own-agents
integrations/agents/control-flow
integrations/agents/crewai
integrations/agents/langchain-agents
integrations/agents/langgraph
integrations/agents/langroid
integrations/agents/livekit
integrations/agents/llama-agents
integrations/agents/openai-agents
integrations/agents/openai-agents-ts
integrations/agents/openai-swarm
integrations/agents/phidata
integrations/agents/pydantic-ai
integrations/agents/strands
integrations/ai-apps
integrations/cloud/azure
integrations/ecosystem
integrations/guardrails/acuvity
integrations/guardrails/aporia
integrations/guardrails/azure-guardrails
integrations/guardrails/bedrock-guardrails
integrations/guardrails/bring-your-own-guardrails
integrations/guardrails/f5-guardrails
integrations/guardrails/javelin
integrations/guardrails/lasso
integrations/guardrails/mistral
integrations/guardrails/palo-alto-panw-prisma
integrations/guardrails/pangea
integrations/guardrails/patronus-ai
integrations/guardrails/pillar
integrations/guardrails/prompt-security
integrations/guardrails/qualifire
integrations/guardrails/regex
integrations/libraries
integrations/libraries/anthropic-computer-use
integrations/libraries/anythingllm
integrations/libraries/autogen
integrations/libraries/claude-code
integrations/libraries/cline
integrations/libraries/codex
integrations/libraries/cursor
integrations/libraries/dspy
integrations/libraries/github-copilot
integrations/libraries/goose
integrations/libraries/instructor
integrations/libraries/janhq
integrations/libraries/langchain-js
integrations/libraries/langchain-python
integrations/libraries/langflow
integrations/libraries/librechat
integrations/libraries/llama-index-python
integrations/libraries/microsoft-semantic-kernel
integrations/libraries/mindsdb
integrations/libraries/mongodb
integrations/libraries/n8n
integrations/libraries/openai-agent-builder
integrations/libraries/openai-agent-builder-python
integrations/libraries/openai-compatible
integrations/libraries/openwebui
integrations/libraries/openwebui/image-generation-with-openwebui
integrations/libraries/promptfoo
integrations/libraries/roo-code
integrations/libraries/supabase
integrations/libraries/tooljet
integrations/libraries/vercel
integrations/libraries/zed
integrations/llms
integrations/llms/ai21
integrations/llms/anthropic
integrations/llms/anthropic/computer-use
integrations/llms/anthropic/count-tokens
integrations/llms/anthropic/prompt-caching
integrations/llms/anthropic/remote-mcp
integrations/llms/anyscale-llama2-mistral-zephyr
integrations/llms/aws-sagemaker
integrations/llms/azure-foundry
integrations/llms/azure-openai/azure-govcloud
integrations/llms/azure-openai/azure-openai
integrations/llms/azure-openai/batches
integrations/llms/azure-openai/files
integrations/llms/azure-openai/fine-tuning
integrations/llms/bedrock/aws-bedrock
integrations/llms/bedrock/aws-govcloud
integrations/llms/bedrock/batches
integrations/llms/bedrock/bedrock-knowledgebase
integrations/llms/bedrock/count-tokens
integrations/llms/bedrock/embeddings
integrations/llms/bedrock/files
integrations/llms/bedrock/fine-tuning
integrations/llms/bedrock/prompt-caching
integrations/llms/byollm
integrations/llms/cerebras
integrations/llms/cohere
integrations/llms/dashscope
integrations/llms/deepbricks
integrations/llms/deepgram
integrations/llms/deepinfra
integrations/llms/deepseek
integrations/llms/featherless
integrations/llms/fireworks
integrations/llms/fireworks/files
integrations/llms/fireworks/fine-tuning
integrations/llms/gemini
integrations/llms/github
integrations/llms/groq
integrations/llms/huggingface
integrations/llms/inference.net
integrations/llms/jina-ai
integrations/llms/lambda
integrations/llms/lemon-fox
integrations/llms/lepton
integrations/llms/lingyi-01.ai
integrations/llms/local-ai
integrations/llms/mistral-ai
integrations/llms/modal
integrations/llms/monster-api
integrations/llms/moonshot
integrations/llms/ncompass
integrations/llms/nebius
integrations/llms/nomic
integrations/llms/novita-ai
integrations/llms/nscale
integrations/llms/ollama
integrations/llms/openai
integrations/llms/openai/batches
integrations/llms/openai/files
integrations/llms/openai/fine-tuning
integrations/llms/openai/prompt-caching-openai
integrations/llms/openai/remote-mcp
integrations/llms/openai/structured-outputs
integrations/llms/openai2
integrations/llms/openai3
integrations/llms/openrouter
integrations/llms/perplexity-ai
integrations/llms/predibase
integrations/llms/recraft-ai
integrations/llms/reka-ai
integrations/llms/replicate
integrations/llms/sambanova
integrations/llms/segmind
integrations/llms/siliconflow
integrations/llms/snowflake-cortex
integrations/llms/stability-ai
integrations/llms/suggest-a-new-integration
integrations/llms/together-ai
integrations/llms/triton
integrations/llms/upstage
integrations/llms/vertex-ai
integrations/llms/vertex-ai/batches
integrations/llms/vertex-ai/controlled-generations
integrations/llms/vertex-ai/count-tokens
integrations/llms/vertex-ai/embeddings
integrations/llms/vertex-ai/files
integrations/llms/vertex-ai/fine-tuning
integrations/llms/vllm
integrations/llms/voyage-ai
integrations/llms/workers-ai
integrations/llms/x-ai
integrations/llms/zhipu
integrations/mcp-clients/claude
integrations/mcp-clients/claude-code
integrations/mcp-clients/cursor
integrations/mcp-clients/librechat
integrations/mcp-clients/vs-code
integrations/mcp-servers
integrations/mcp-servers/atlassian-mcp-server
integrations/mcp-servers/cerebras-code-mcp-server
integrations/mcp-servers/datadog-mcp-server
integrations/mcp-servers/figma-mcp-server
integrations/mcp-servers/firebase-mcp-server
integrations/mcp-servers/firecrawl-mcp-server
integrations/mcp-servers/github-mcp-server
integrations/mcp-servers/gitlab-mcp-server
integrations/mcp-servers/grafana-mcp-server
integrations/mcp-servers/kubernetes-mcp-server
integrations/mcp-servers/linear-mcp-server
integrations/mcp-servers/notion-mcp-server
integrations/mcp-servers/open-library-mcp-server
integrations/mcp-servers/playwright-mcp-server
integrations/mcp-servers/postman-mcp-server
integrations/mcp-servers/qdrant-mcp-server
integrations/mcp-servers/stripe-mcp-server
integrations/mcp-servers/vectara-mcp-server
integrations/partner
integrations/plugins/exa
integrations/tracing-providers
integrations/tracing-providers/arize
integrations/tracing-providers/future-agi
integrations/tracing-providers/honeyhive
integrations/tracing-providers/langfuse
integrations/tracing-providers/langsmith
integrations/tracing-providers/logfire
integrations/tracing-providers/ml-flow
integrations/tracing-providers/openlit
integrations/tracing-providers/opentelemetry-python-sdk
integrations/tracing-providers/phoenix
integrations/tracing-providers/traceloop
integrations/vector-databases/milvus
integrations/vector-databases/qdrant
introduction/feature-overview
introduction/make-your-first-request
introduction/what-is-portkey
private/catch-anthropic-errors
product/administration/configure-api-key-access-permissions
product/administration/configure-logs-access-permissions-in-workspace
product/administration/configure-model-access-permissioning-for-ai-integratinon
product/administration/configure-virtual-key-access-permissions
product/administration/configure-workspace-provisioning-for-your-ai-integrations
product/administration/configuring-request-logging
product/administration/enforce-budget-and-rate-limit
product/administration/enforce-budget-limits-on-your-ai-provider
product/administration/enforce-default-config
product/administration/enforce-orgnization-level-guardrails
product/administration/enforce-rate-limits-on-your-ai-provider
product/administration/enforce-workspace-budget-limts-and-rate-limits
product/administration/enforce-workspace-level-guardials
product/administration/enforcing-request-metadata
product/ai-gateway
product/ai-gateway/automatic-retries
product/ai-gateway/batches
product/ai-gateway/cache-simple-and-semantic
product/ai-gateway/canary-testing
product/ai-gateway/circuit-breaker
product/ai-gateway/conditional-routing
product/ai-gateway/configs
product/ai-gateway/fallbacks
product/ai-gateway/files
product/ai-gateway/fine-tuning
product/ai-gateway/load-balancing
product/ai-gateway/multimodal-capabilities
product/ai-gateway/multimodal-capabilities/function-calling
product/ai-gateway/multimodal-capabilities/image-generation
product/ai-gateway/multimodal-capabilities/speech-to-text
product/ai-gateway/multimodal-capabilities/text-to-speech
product/ai-gateway/multimodal-capabilities/thinking-mode
product/ai-gateway/multimodal-capabilities/vision
product/ai-gateway/realtime-api
product/ai-gateway/remote-mcp
product/ai-gateway/request-timeouts
product/ai-gateway/strict-open-ai-compliance
product/ai-gateway/universal-api
product/ai-gateway/virtual-keys
product/ai-gateway/virtual-keys/bedrock-amazon-assumed-role
product/ai-gateway/virtual-keys/budget-limits
product/ai-gateway/virtual-keys/rate-limits
product/autonomous-fine-tuning
product/enterprise-offering
product/enterprise-offering/access-control-management
product/enterprise-offering/analytics-logs-export
product/enterprise-offering/audit-logs
product/enterprise-offering/budget-limits
product/enterprise-offering/budget-policies
product/enterprise-offering/cloud-marketplace/aws
product/enterprise-offering/components
product/enterprise-offering/kms
product/enterprise-offering/logs-export
product/enterprise-offering/org-management
product/enterprise-offering/org-management/api-keys-authn-and-authz
product/enterprise-offering/org-management/jwt
product/enterprise-offering/org-management/ldap
product/enterprise-offering/org-management/organizations
product/enterprise-offering/org-management/scim/azure-ad
product/enterprise-offering/org-management/scim/okta
product/enterprise-offering/org-management/scim/scim
product/enterprise-offering/org-management/sso
product/enterprise-offering/org-management/user-roles-and-permissions
product/enterprise-offering/org-management/workspaces
product/enterprise-offering/security-portkey
product/guardrails
product/guardrails/creating-raw-guardrails-in-json
product/guardrails/embedding-guardrails
product/guardrails/list-of-guardrail-checks
product/guardrails/pii-redaction
product/mcp
product/mcp-gateway
product/mcp-gateway/architecture
product/mcp-gateway/deployment
product/mcp-gateway/mcp-clients
product/mcp-gateway/mcp-hub
product/mcp-gateway/quickstart
product/model-catalog
product/model-catalog/budget-limits
product/model-catalog/connect-bedrock-with-amazon-assumed-role
product/model-catalog/custom-models
product/model-catalog/integrations
product/model-catalog/model-overrides
product/model-catalog/model-provisioning
product/model-catalog/rate-limits
product/model-catalog/workspace-provisioning
product/observability
product/observability/analytics
product/observability/auto-instrumentation
product/observability/budget-limits
product/observability/cost-management
product/observability/feedback
product/observability/filters
product/observability/logs
product/observability/logs-export
product/observability/logs-export-deprecated
product/observability/metadata
product/observability/opentelemetry
product/observability/opentelemetry/list-of-supported-otel-instrumenters
product/observability/traces
product/open-source
product/product-feature-comparison
product/prompt-engineering-studio
product/prompt-engineering-studio/prompt-api
product/prompt-engineering-studio/prompt-guides
product/prompt-engineering-studio/prompt-integration
product/prompt-engineering-studio/prompt-library
product/prompt-engineering-studio/prompt-observability
product/prompt-engineering-studio/prompt-partial
product/prompt-engineering-studio/prompt-playground
product/prompt-engineering-studio/prompt-versioning
product/prompt-engineering-studio/tool-library
product/security/pii
self-hosting/hybrid-deployments/architecture
self-hosting/hybrid-deployments/aws/eks
self-hosting/hybrid-deployments/aws/marketplace
self-hosting/hybrid-deployments/azure
self-hosting/hybrid-deployments/gcp
self-hosting/prometheus-metrics
support/common-errors-and-resolutions
support/contact-us
support/developer-forum
support/portkeys-december-migration
support/upgrade-to-model-catalog
virtual_key_old/integrations/agents
virtual_key_old/integrations/agents/autogen
virtual_key_old/integrations/agents/bring-your-own-agents
virtual_key_old/integrations/agents/control-flow
virtual_key_old/integrations/agents/crewai
virtual_key_old/integrations/agents/langchain-agents
virtual_key_old/integrations/agents/langgraph
virtual_key_old/integrations/agents/langroid
virtual_key_old/integrations/agents/livekit
virtual_key_old/integrations/agents/llama-agents
virtual_key_old/integrations/agents/openai-agents
virtual_key_old/integrations/agents/openai-agents-ts
virtual_key_old/integrations/agents/openai-swarm
virtual_key_old/integrations/agents/phidata
virtual_key_old/integrations/agents/pydantic-ai
virtual_key_old/integrations/agents/strands
virtual_key_old/integrations/agents/strands-backup
virtual_key_old/integrations/ai-apps
virtual_key_old/integrations/cloud/azure
virtual_key_old/integrations/ecosystem
virtual_key_old/integrations/guardrails/acuvity
virtual_key_old/integrations/guardrails/aporia
virtual_key_old/integrations/guardrails/azure-guardrails
virtual_key_old/integrations/guardrails/bedrock-guardrails
virtual_key_old/integrations/guardrails/bring-your-own-guardrails
virtual_key_old/integrations/guardrails/lasso
virtual_key_old/integrations/guardrails/mistral
virtual_key_old/integrations/guardrails/pangea
virtual_key_old/integrations/guardrails/patronus-ai
virtual_key_old/integrations/guardrails/pillar
virtual_key_old/integrations/guardrails/prompt-security
virtual_key_old/integrations/libraries
virtual_key_old/integrations/libraries/anthropic-computer-use
virtual_key_old/integrations/libraries/anythingllm
virtual_key_old/integrations/libraries/autogen
virtual_key_old/integrations/libraries/claude-code
virtual_key_old/integrations/libraries/cline
virtual_key_old/integrations/libraries/codex
virtual_key_old/integrations/libraries/dspy
virtual_key_old/integrations/libraries/goose
virtual_key_old/integrations/libraries/instructor
virtual_key_old/integrations/libraries/janhq
virtual_key_old/integrations/libraries/langchain-js
virtual_key_old/integrations/libraries/langchain-python
virtual_key_old/integrations/libraries/librechat
virtual_key_old/integrations/libraries/llama-index-python
virtual_key_old/integrations/libraries/microsoft-semantic-kernel
virtual_key_old/integrations/libraries/mindsdb
virtual_key_old/integrations/libraries/mongodb
virtual_key_old/integrations/libraries/n8n
virtual_key_old/integrations/libraries/openai-compatible
virtual_key_old/integrations/libraries/openwebui
virtual_key_old/integrations/libraries/promptfoo
virtual_key_old/integrations/libraries/roo-code
virtual_key_old/integrations/libraries/supabase
virtual_key_old/integrations/libraries/tooljet
virtual_key_old/integrations/libraries/vercel
virtual_key_old/integrations/libraries/zed
virtual_key_old/integrations/llms
virtual_key_old/integrations/llms/ai21
virtual_key_old/integrations/llms/anthropic
virtual_key_old/integrations/llms/anthropic/computer-use
virtual_key_old/integrations/llms/anthropic/prompt-caching
virtual_key_old/integrations/llms/anyscale-llama2-mistral-zephyr
virtual_key_old/integrations/llms/aws-sagemaker
virtual_key_old/integrations/llms/azure-foundry
virtual_key_old/integrations/llms/azure-openai/azure-openai
virtual_key_old/integrations/llms/azure-openai/batches
virtual_key_old/integrations/llms/azure-openai/files
virtual_key_old/integrations/llms/azure-openai/fine-tuning
virtual_key_old/integrations/llms/bedrock/aws-bedrock
virtual_key_old/integrations/llms/bedrock/batches
virtual_key_old/integrations/llms/bedrock/embeddings
virtual_key_old/integrations/llms/bedrock/files
virtual_key_old/integrations/llms/bedrock/fine-tuning
virtual_key_old/integrations/llms/bedrock/prompt-caching
virtual_key_old/integrations/llms/byollm
virtual_key_old/integrations/llms/cerebras
virtual_key_old/integrations/llms/cohere
virtual_key_old/integrations/llms/dashscope
virtual_key_old/integrations/llms/deepbricks
virtual_key_old/integrations/llms/deepgram
virtual_key_old/integrations/llms/deepinfra
virtual_key_old/integrations/llms/deepseek
virtual_key_old/integrations/llms/fireworks
virtual_key_old/integrations/llms/fireworks/files
virtual_key_old/integrations/llms/fireworks/fine-tuning
virtual_key_old/integrations/llms/gemini
virtual_key_old/integrations/llms/github
virtual_key_old/integrations/llms/google-palm
virtual_key_old/integrations/llms/groq
virtual_key_old/integrations/llms/huggingface
virtual_key_old/integrations/llms/inference.net
virtual_key_old/integrations/llms/jina-ai
virtual_key_old/integrations/llms/lambda
virtual_key_old/integrations/llms/lemon-fox
virtual_key_old/integrations/llms/lepton
virtual_key_old/integrations/llms/lingyi-01.ai
virtual_key_old/integrations/llms/local-ai
virtual_key_old/integrations/llms/mistral-ai
virtual_key_old/integrations/llms/monster-api
virtual_key_old/integrations/llms/moonshot
virtual_key_old/integrations/llms/ncompass
virtual_key_old/integrations/llms/nebius
virtual_key_old/integrations/llms/nomic
virtual_key_old/integrations/llms/novita-ai
virtual_key_old/integrations/llms/nscale
virtual_key_old/integrations/llms/ollama
virtual_key_old/integrations/llms/openai
virtual_key_old/integrations/llms/openai/batches
virtual_key_old/integrations/llms/openai/files
virtual_key_old/integrations/llms/openai/fine-tuning
virtual_key_old/integrations/llms/openai/prompt-caching-openai
virtual_key_old/integrations/llms/openai/structured-outputs
virtual_key_old/integrations/llms/openai2
virtual_key_old/integrations/llms/openai3
virtual_key_old/integrations/llms/openrouter
virtual_key_old/integrations/llms/perplexity-ai
virtual_key_old/integrations/llms/predibase
virtual_key_old/integrations/llms/recraft-ai
virtual_key_old/integrations/llms/reka-ai
virtual_key_old/integrations/llms/replicate
virtual_key_old/integrations/llms/sambanova
virtual_key_old/integrations/llms/segmind
virtual_key_old/integrations/llms/siliconflow
virtual_key_old/integrations/llms/snowflake-cortex
virtual_key_old/integrations/llms/stability-ai
virtual_key_old/integrations/llms/suggest-a-new-integration
virtual_key_old/integrations/llms/together-ai
virtual_key_old/integrations/llms/triton
virtual_key_old/integrations/llms/upstage
virtual_key_old/integrations/llms/vertex-ai
virtual_key_old/integrations/llms/vertex-ai/batches
virtual_key_old/integrations/llms/vertex-ai/controlled-generations
virtual_key_old/integrations/llms/vertex-ai/embeddings
virtual_key_old/integrations/llms/vertex-ai/files
virtual_key_old/integrations/llms/vertex-ai/fine-tuning
virtual_key_old/integrations/llms/vllm
virtual_key_old/integrations/llms/voyage-ai
virtual_key_old/integrations/llms/workers-ai
virtual_key_old/integrations/llms/x-ai
virtual_key_old/integrations/llms/zhipu
virtual_key_old/integrations/partner
virtual_key_old/integrations/plugins/exa
virtual_key_old/integrations/tracing-providers
virtual_key_old/integrations/tracing-providers/arize
virtual_key_old/integrations/tracing-providers/langfuse
virtual_key_old/integrations/tracing-providers/logfire
virtual_key_old/integrations/vector-databases/milvus
virtual_key_old/integrations/vector-databases/qdrant
virtual_key_old/introduction/feature-overview
virtual_key_old/introduction/make-your-first-request
virtual_key_old/introduction/what-is-portkey
virtual_key_old/product/administration/configure-api-key-access-permissions
virtual_key_old/product/administration/configure-logs-access-permissions-in-workspace
virtual_key_old/product/administration/configure-virtual-key-access-permissions
virtual_key_old/product/administration/enforce-budget-and-rate-limit
virtual_key_old/product/administration/enforce-default-config
virtual_key_old/product/administration/enforce-orgnization-level-guardrails
virtual_key_old/product/administration/enforce-workspace-budget-limts-and-rate-limits
virtual_key_old/product/administration/enforce-workspace-level-guardials
virtual_key_old/product/administration/enforcing-request-metadata
virtual_key_old/product/ai-gateway
virtual_key_old/product/ai-gateway/automatic-retries
virtual_key_old/product/ai-gateway/batches
virtual_key_old/product/ai-gateway/cache-simple-and-semantic
virtual_key_old/product/ai-gateway/canary-testing
virtual_key_old/product/ai-gateway/conditional-routing
virtual_key_old/product/ai-gateway/configs
virtual_key_old/product/ai-gateway/fallbacks
virtual_key_old/product/ai-gateway/files
virtual_key_old/product/ai-gateway/fine-tuning
virtual_key_old/product/ai-gateway/load-balancing
virtual_key_old/product/ai-gateway/multimodal-capabilities
virtual_key_old/product/ai-gateway/multimodal-capabilities/function-calling
virtual_key_old/product/ai-gateway/multimodal-capabilities/image-generation
virtual_key_old/product/ai-gateway/multimodal-capabilities/speech-to-text
virtual_key_old/product/ai-gateway/multimodal-capabilities/text-to-speech
virtual_key_old/product/ai-gateway/multimodal-capabilities/thinking-mode
virtual_key_old/product/ai-gateway/multimodal-capabilities/vision
virtual_key_old/product/ai-gateway/realtime-api
virtual_key_old/product/ai-gateway/remote-mcp
virtual_key_old/product/ai-gateway/request-timeouts
virtual_key_old/product/ai-gateway/strict-open-ai-compliance
virtual_key_old/product/ai-gateway/universal-api
virtual_key_old/product/ai-gateway/virtual-keys
virtual_key_old/product/ai-gateway/virtual-keys/bedrock-amazon-assumed-role
virtual_key_old/product/ai-gateway/virtual-keys/budget-limits
virtual_key_old/product/ai-gateway/virtual-keys/rate-limits
virtual_key_old/product/autonomous-fine-tuning
virtual_key_old/product/enterprise-offering
virtual_key_old/product/enterprise-offering/access-control-management
virtual_key_old/product/enterprise-offering/analytics-logs-export
virtual_key_old/product/enterprise-offering/audit-logs
virtual_key_old/product/enterprise-offering/budget-limits
virtual_key_old/product/enterprise-offering/cloud-marketplace/aws
virtual_key_old/product/enterprise-offering/components
virtual_key_old/product/enterprise-offering/kms
virtual_key_old/product/enterprise-offering/logs-export
virtual_key_old/product/enterprise-offering/org-management
virtual_key_old/product/enterprise-offering/org-management/api-keys-authn-and-authz
virtual_key_old/product/enterprise-offering/org-management/jwt
virtual_key_old/product/enterprise-offering/org-management/ldap
virtual_key_old/product/enterprise-offering/org-management/organizations
virtual_key_old/product/enterprise-offering/org-management/scim/azure-ad
virtual_key_old/product/enterprise-offering/org-management/scim/okta
virtual_key_old/product/enterprise-offering/org-management/scim/scim
virtual_key_old/product/enterprise-offering/org-management/sso
virtual_key_old/product/enterprise-offering/org-management/user-roles-and-permissions
virtual_key_old/product/enterprise-offering/org-management/workspaces
virtual_key_old/product/enterprise-offering/private-cloud-deployments
virtual_key_old/product/enterprise-offering/private-cloud-deployments/architecture
virtual_key_old/product/enterprise-offering/private-cloud-deployments/aws
virtual_key_old/product/enterprise-offering/private-cloud-deployments/azure
virtual_key_old/product/enterprise-offering/private-cloud-deployments/cloudflare-workers
virtual_key_old/product/enterprise-offering/private-cloud-deployments/f5-app-stack
virtual_key_old/product/enterprise-offering/private-cloud-deployments/gcp
virtual_key_old/product/enterprise-offering/security-portkey
virtual_key_old/product/guardrails
virtual_key_old/product/guardrails/creating-raw-guardrails-in-json
virtual_key_old/product/guardrails/embedding-guardrails
virtual_key_old/product/guardrails/list-of-guardrail-checks
virtual_key_old/product/guardrails/pii-redaction
virtual_key_old/product/integrations
virtual_key_old/product/integrations/agents
virtual_key_old/product/integrations/ai-apps
virtual_key_old/product/integrations/cloud
virtual_key_old/product/integrations/guardrails
virtual_key_old/product/integrations/libraries
virtual_key_old/product/integrations/plugins
virtual_key_old/product/integrations/tracing
virtual_key_old/product/mcp
virtual_key_old/product/model-catalog
virtual_key_old/product/observability
virtual_key_old/product/observability/analytics
virtual_key_old/product/observability/auto-instrumentation
virtual_key_old/product/observability/budget-limits
virtual_key_old/product/observability/feedback
virtual_key_old/product/observability/filters
virtual_key_old/product/observability/logs
virtual_key_old/product/observability/logs-export
virtual_key_old/product/observability/logs-export-deprecated
virtual_key_old/product/observability/metadata
virtual_key_old/product/observability/traces
virtual_key_old/product/open-source
virtual_key_old/product/product-feature-comparison
virtual_key_old/product/prompt-engineering-studio
virtual_key_old/product/prompt-engineering-studio/prompt-api
virtual_key_old/product/prompt-engineering-studio/prompt-guides
virtual_key_old/product/prompt-engineering-studio/prompt-integration
virtual_key_old/product/prompt-engineering-studio/prompt-library
virtual_key_old/product/prompt-engineering-studio/prompt-observability
virtual_key_old/product/prompt-engineering-studio/prompt-partial
virtual_key_old/product/prompt-engineering-studio/prompt-playground
virtual_key_old/product/prompt-engineering-studio/prompt-versioning
virtual_key_old/product/prompt-engineering-studio/tool-library
virtual_key_old/product/security/pii
/integrations/observability-integrations
/integrations/tracing-providers
/changelog/enterprise/oct-24
/changelog/product/oct-24
/api-reference
/api-reference/introduction
/api-reference/authentication
/api-reference/headers
/api-reference/config-object
/api-reference/portkey-sdk-client
/provider-endpoints/supported-providers
/api-reference/response-schema
/provider-endpoints
/provider-endpoints/assistants-api/assistants/create-assistant
/provider-endpoints/assistants-api/assistants/delete-assistant
/provider-endpoints/assistants-api/assistants/list-assistants
/provider-endpoints/assistants-api/assistants/modify-assistant
/provider-endpoints/assistants-api/assistants/retrieve-assistant
/provider-endpoints/assistants-api/assistants
/provider-endpoints/assistants-api/messages/create-message
/provider-endpoints/assistants-api/messages/delete-message
/provider-endpoints/assistants-api/messages/list-messages
/provider-endpoints/assistants-api/messages/modify-message
/provider-endpoints/assistants-api/messages/retrieve-message
/provider-endpoints/assistants-api/messages
/provider-endpoints/assistants-api/run-steps/list-run-steps
/provider-endpoints/assistants-api/run-steps/retrieve-run-steps
/provider-endpoints/assistants-api/run-steps
/provider-endpoints/assistants-api/runs/cancel-run
/provider-endpoints/assistants-api/runs/create-run
/provider-endpoints/assistants-api/runs/create-thread-and-run
/provider-endpoints/assistants-api/runs/list-runs
/provider-endpoints/assistants-api/runs/modify-run
/provider-endpoints/assistants-api/runs/retrieve-run
/provider-endpoints/assistants-api/runs/submit-tool-outputs-to-run
/provider-endpoints/assistants-api/runs
/provider-endpoints/assistants-api/threads/create-thread
/provider-endpoints/assistants-api/threads/delete-thread
/provider-endpoints/assistants-api/threads/modify-thread
/provider-endpoints/assistants-api/threads/retrieve-thread
/provider-endpoints/assistants-api/threads
/provider-endpoints/assistants-api
/provider-endpoints/audio/create-speech
/provider-endpoints/audio/create-transcription
/provider-endpoints/audio/create-translation
/provider-endpoints/audio
/provider-endpoints/batch/cancel-batch
/provider-endpoints/batch/create-batch
/provider-endpoints/batch/list-batch
/provider-endpoints/batch/retrieve-batch
/provider-endpoints/batch
/provider-endpoints/chat
/provider-endpoints/completions
/provider-endpoints/embeddings
/provider-endpoints/files/delete-file
/provider-endpoints/files/list-files
/provider-endpoints/files/retrieve-file-content
/provider-endpoints/files/retrieve-file
/provider-endpoints/files/upload-file
/provider-endpoints/files
/provider-endpoints/fine-tuning/cancel-fine-tuning
/provider-endpoints/fine-tuning/create-fine-tuning-job
/provider-endpoints/fine-tuning/list-fine-tuning-checkpoints
/provider-endpoints/fine-tuning/list-fine-tuning-events
/provider-endpoints/fine-tuning/list-fine-tuning-jobs
/provider-endpoints/fine-tuning/retrieve-fine-tuning-job
/provider-endpoints/fine-tuning
/provider-endpoints/gateway-for-other-apis
/provider-endpoints/images/create-image-edit
/provider-endpoints/images/create-image-variation
/provider-endpoints/images/create-image
/provider-endpoints/images
/provider-endpoints/moderations
/portkey-endpoints
/portkey-endpoints/admin/user-invites/delete-a-user-invite
/portkey-endpoints/admin/user-invites/invite-a-user
/portkey-endpoints/admin/user-invites/retrieve-all-user-invites
/portkey-endpoints/admin/user-invites/retrieve-an-invite
/portkey-endpoints/admin/users/remove-a-user
/portkey-endpoints/admin/users/retrieve-a-user
/portkey-endpoints/admin/users/retrieve-all-users
/portkey-endpoints/admin/users/update-a-user
/portkey-endpoints/admin/workspace-members/add-a-workspace-member
/portkey-endpoints/admin/workspace-members/remove-workspace-member
/portkey-endpoints/admin/workspace-members/retrieve-a-workspace-member
/portkey-endpoints/admin/workspace-members/retrieve-all-workspace-members
/portkey-endpoints/admin/workspace-members/update-workspace-member
/portkey-endpoints/admin/workspaces/create-workspace
/portkey-endpoints/admin/workspaces/delete-a-workspace
/portkey-endpoints/admin/workspaces/retrieve-a-workspace
/portkey-endpoints/admin/workspaces/retrieve-all-workspaces
/portkey-endpoints/admin/workspaces/update-workspace
/portkey-endpoints/analytics/graphs-time-series-data/get-cache-hit-latency-data
/portkey-endpoints/analytics/graphs-time-series-data/get-cache-hit-rate-data
/portkey-endpoints/analytics/graphs-time-series-data/get-cost-data
/portkey-endpoints/analytics/graphs-time-series-data/get-error-rate-data
/portkey-endpoints/analytics/graphs-time-series-data/get-errors-data
/portkey-endpoints/analytics/graphs-time-series-data/get-feedback-data
/portkey-endpoints/analytics/graphs-time-series-data/get-feedback-per-ai-models
/portkey-endpoints/analytics/graphs-time-series-data/get-feedback-score-distribution-data
/portkey-endpoints/analytics/graphs-time-series-data/get-latency-data
/portkey-endpoints/analytics/graphs-time-series-data/get-requests-data
/portkey-endpoints/analytics/graphs-time-series-data/get-requests-per-user
/portkey-endpoints/analytics/graphs-time-series-data/get-rescued-requests-data
/portkey-endpoints/analytics/graphs-time-series-data/get-status-code-data
/portkey-endpoints/analytics/graphs-time-series-data/get-tokens-data
/portkey-endpoints/analytics/graphs-time-series-data/get-unique-status-code-data
/portkey-endpoints/analytics/graphs-time-series-data/get-users-data
/portkey-endpoints/analytics/graphs-time-series-data/get-weighted-feeback-data
/portkey-endpoints/analytics/groups-paginated-data/get-metadata-grouped-data
/portkey-endpoints/analytics/groups-paginated-data/get-model-grouped-data
/portkey-endpoints/analytics/groups-paginated-data/get-user-grouped-data
/portkey-endpoints/analytics/summary/get-all-cache-data
/portkey-endpoints/api-keys/create-api-key
/portkey-endpoints/api-keys/delete-an-api-key
/portkey-endpoints/api-keys/list-api-keys
/portkey-endpoints/api-keys/retrieve-an-api-key
/portkey-endpoints/api-keys/update-api-key
/portkey-endpoints/configs/create-config
/portkey-endpoints/configs/list-configs
/portkey-endpoints/configs/retrieve-config
/portkey-endpoints/configs/update-config
/portkey-endpoints/feedback/create-feedback
/docs/portkey-endpoints/feedback/create-feedback
/portkey-endpoints/feedback/update-feedback
/docs/portkey-endpoints/feedback/update-feedback
/portkey-endpoints/guardrails
/docs/portkey-endpoints/logs/insert-a-log
/portkey-endpoints/logs/insert-a-log
/portkey-endpoints/logs/log-exports-beta/cancel-a-log-export
/portkey-endpoints/logs/log-exports-beta/create-a-log-export
/portkey-endpoints/logs/log-exports-beta/download-a-log-export
/portkey-endpoints/logs/log-exports-beta/list-log-exports
/portkey-endpoints/logs/log-exports-beta/retrieve-a-log-export
/portkey-endpoints/logs/log-exports-beta/start-a-log-export
/portkey-endpoints/logs/log-exports-beta/update-a-log-export
/portkey-endpoints/prompts/prompt-completion
/portkey-endpoints/prompts/render
/portkey-endpoints/virtual-keys/create-virtual-key
/portkey-endpoints/virtual-keys/delete-virtual-key
/portkey-endpoints/virtual-keys/list-virtual-keys
/portkey-endpoints/virtual-keys/retrieve-virtual-key
/portkey-endpoints/virtual-keys/update-virtual-key
/product/observability-modern-monitoring-for-llms
/product/observability-modern-monitoring-for-llms/:slug*
/product/guardrails/list-of-guardrail-checks/:slug*
/product/ai-gateway-streamline-llm-integrations
/product/ai-gateway-streamline-llm-integrations/:slug*
/welcome/agents
/welcome/agents/:slug*
/welcome/integration-guides
/welcome/integration-guides/:slug*
/key-features/prompt-management#versioning-of-prompts
/introduction/welcome-to-portkey
/introduction/getting-started
/introduction/features
/introduction/portkey-headers
/portkey-features/ai-gateway
/portkey-features/ai-gateway/:slug*
/portkey-features/ai-gateway/configs
/portkey-features/ai-gateway/simple-and-semantic-cache
/portkey-features/ai-gateway/fallbacks-on-llms
/portkey-features/observability
/portkey-features/observability/logs-and-analytics
/portkey-features/observability/request-tracing
/portkey-features/observability/custom-metadata
/portkey-features/model-management
/portkey-features/feedback
/portkey-features/security-and-compliance
/portkey-features/security-and-compliance/virtual-keys
/portkey-features/continuous-fine-tuning-beta
/sdk
/sdk/python
/sdk/node
/integrations
/integrations/llm-providers
/integrations/llm-providers/open-ai-sdk
/integrations/llm-providers/anthropic-sdk
/integrations/llm-providers/whisper
/integrations/llm-providers/anyscale-llama-2-and-mistral-7b
/integrations/llm-providers/anyscale-llama-2-and-mistral-7b/fallback-to-llama2-70b-in-llamaindex
/integrations/llm-providers/cohere
/integrations/llamaindex
/integrations/llamaindex/implementing-fallbacks-and-retries
/integrations/llamaindex/implementing-load-balancing
/integrations/llamaindex/implementing-semantic-caching
/integrations/llamaindex/observability
/integrations/langchain
/integrations/rest-api
/integrations/rest-api/portkey-headers
/cookbook
/cookbook/few-shot-prompting
/support-and-faq/why-portkey
/support-and-faq/why-portkey/observability
/support-and-faq/why-portkey/lower-cost-and-latency
/support-and-faq/why-portkey/improve-llm-success-rate
/support-and-faq/why-portkey/optimise-generation-quality
/support-and-faq/why-portkey/hide-pii-from-llms
/support-and-faq/common-errors-and-resolutions
/overview/introduction
/overview/features-overview
/getting-started/setup-your-account
/getting-started/quick-integration
/how-portkey-works/portkey-modes
/how-portkey-works/portkey-headers
/how-portkey-works/supported-llms
/key-features/request-caching
/key-features/request-tracing
/key-features/automatic-retries
/key-features/circuit-breaker
/key-features/custom-metadata
/key-features/fallbacks-on-llms
/key-features/load-balancing
/key-features/feedback-api
/key-features/logs-and-analytics
/key-features/ai-provider-keys
/key-features/prompt-management
/key-features/prompt-management/few-shot-prompting
/integration-guides/open-ai-sdk
/integration-guides/llamaindex
/integration-guides/llamaindex/implementing-fallbacks-and-retries
/integration-guides/llamaindex/implementing-load-balancing
/integration-guides/llamaindex/implementing-semantic-caching
/integration-guides/llamaindex/observability
/integration-guides/langchain
/integration-guides/cohere
/integration-guides/anthropic-sdk
/integration-guides/microsoft-guidance
/integration-guides/rest-api
/why-portkey/observability
/why-portkey/lower-cost-and-latency
/why-portkey/improve-llm-success-rate
/why-portkey/optimise-generation-quality
/why-portkey/hide-pii-from-llms
/troubleshooting-and-support/common-errors-and-resolutions
/open-source
/open-source/rubeus-by-portkey
/support-and-faq/join-portkey-on-discord
/support-and-faq/contacting-support
/support-and-faq/reporting-issues
/troubleshooting-and-support/reporting-issues
/troubleshooting-and-support/contacting-support
/troubleshooting-and-support/join-portkey-on-discord
/welcome/what-is-portkey
/welcome/readme
/welcome/integration-guides/openai
/welcome/make-your-first-request
/product/ai-gateway-streamline-llm-integrations/cache-simple-and-semantic
/welcome/integration-guides/langchain-python
/welcome/integration-guides/azure-openai
/api-reference/chat-completions
/product/ai-gateway-streamline-llm-integrations/virtual-keys
/welcome/integration-guides/llama-index-python
/welcome/integration-guides/anthropic
/api-reference/gateway-for-other-apis
/welcome/integration-guides/ollama
/cookbooks/few-shot-prompting
/welcome/integration-guides/gemini
product/guardrails/bedrock-guardrials
/api-reference/prompts
/welcome/integration-guides/aws-bedrock
/product/prompt-library/retrieve-prompt-templates
/api-reference/embeddings
/api-reference/prompts/prompt-completion
/api-reference/completions
/welcome/integration-guides/anyscale-llama2-mistral-zephyr
/cookbooks/a-b-test-prompts-and-models
/changelog/portkeys-december-migration
/portkey-endpoints/configs
/welcome/integration-guides/autogen
/api-reference/evals
/api-reference/feedback
/cookbooks/function-calling
/portkey-endpoints/virtual-keys
/product/ai-gateway-streamline-llm-integrations/virtual-keys/budget-limits-enterprise-feature
/portkey-endpoints/prompts
/api-reference/completions-1
/portkey-endpoints/admin
/cookbooks/enforcing-json-schema-with-anyscale-and-together
/api-reference/logs
/cookbooks/emotions-with-gpt-4o
/product/ai-gateway-streamline-llm-integrations/multimodal-capabilities/vision-1
/portkey-endpoints/api-keys
/portkey-endpoints/analytics/graphs-time-series-data
/api-reference/virtual-keys
/guides/practitioners-cookbooks/quickstarts/a-b-test-prompts-and-models
/portkey-endpoints/logs
/integrations/llms/openai/structued-outputs
/portkey-endpoints/analytics
/portkey-endpoints/analytics/groups-paginated-data
/portkey-endpoints/admin/workspaces
/product/enterprise-offering/components/log-store/mongodb
/portkey-docs/introduction/getting-started
/api-reference/admin-api/control-plane/admin/:slug*
/integrations/llms/aws-bedrock
/product/prompt-library/advanced-prompting-with-json-mode
/product/prompt-library/prompt-partials
/product/prompt-library/prompt-templates
/product/prompt-library/retrieve-prompts
/product/prompt-library
/guides/use-cases/build-a-chatbot-using-portkeys-prompt-templates
/integrations/tools/exa
/api-reference/inference-api/sdks/supported-sdks
/api-reference/inference-api/portkey-sdk-client
/api-reference/inference-api/sdks/c-sharp
/product/guardrails/aporia
/product/guardrails/acuvity
/product/guardrails/azure-guardrails
/product/guardrails/bedrock-guardrails
/product/guardrails/lasso
/product/guardrails/mistral
/product/guardrails/pangea
/product/guardrails/patronus-ai
/product/guardrails/pillar
/product/guardrails/prompt-security
/product/guardrails/qualifire
/product/guardrails/bring-your-own-guardrails
/product/integrations/models/custom-models
/pricing/quote
/product/integrations/model-overrides
/product/enterprise-offering/private-cloud-deployments/aws
/product/enterprise-offering/private-cloud-deployments/azure
/product/enterprise-offering/private-cloud-deployments/gcp
/product/enterprise-offering/private-cloud-deployments/cloudflare-workers
/product/enterprise-offering/private-cloud-deployments/f5-app-stack
/product/enterprise-offering/private-cloud-deployments/architecture
/product/enterprise-offering/private-cloud-deployments/prometheus-metrics
/product/enterprise-offering/cloud-marketplace/aws
Page revalidation complete
Successfully deleted stale tracked asset(s)
Queued update of llms-full.txt
Skipping Vercel revalidation (subdomain not in revalidation list)
Loading