Skip to content

GCP Playground policy for LLM usage #1720

@KevyVo

Description

@KevyVo

Right now, it seems that when I try to deploy using the Vercel Model Router, the router is unable to use the LLM on the GCP Playground.

Sample: DefangLabs/samples#545

DEFAULT 2025-12-13T22:48:25.665744Z Error in agent stream {
DEFAULT 2025-12-13T22:48:25.665772Z error: Error [AI_APICallError]: Not Found
DEFAULT 2025-12-13T22:48:25.665778Z at <unknown> (.next/server/chunks/_fa6a73b8._.js:1:24035)
DEFAULT 2025-12-13T22:48:25.665787Z at async F (.next/server/chunks/_fa6a73b8._.js:1:22485)
DEFAULT 2025-12-13T22:48:25.665792Z at async d.doStream (.next/server/chunks/_fa6a73b8._.js:243:49488)
DEFAULT 2025-12-13T22:48:25.665797Z at async c.doStream (.next/server/chunks/_fa6a73b8._.js:94:88250)
DEFAULT 2025-12-13T22:48:25.665801Z at async a.default.retries (.next/server/chunks/_fa6a73b8._.js:99:658)
DEFAULT 2025-12-13T22:48:25.665805Z at async Module.s (.next/server/chunks/08935_p-retry_index_87cfd28f.js:1:3329)
DEFAULT 2025-12-13T22:48:25.665809Z at async createStream (.next/server/chunks/_fa6a73b8._.js:99:572)
DEFAULT 2025-12-13T22:48:25.665813Z at async Object.start (.next/server/chunks/_fa6a73b8._.js:96:76811) {
DEFAULT 2025-12-13T22:48:25.665817Z cause: undefined,
DEFAULT 2025-12-13T22:48:25.665823Z url: 'https://us-central1-aiplatform.googleapis.com/v1beta1/projects/defang-playground-prod/locations/us-central1/publishers/google/google/gemini-2.5-flash:streamGenerateContent?alt=sse',
DEFAULT 2025-12-13T22:48:25.665827Z requestBodyValues: {
DEFAULT 2025-12-13T22:48:25.665831Z generationConfig: [Object],
DEFAULT 2025-12-13T22:48:25.665835Z contents: [Array],
DEFAULT 2025-12-13T22:48:25.665838Z systemInstruction: [Object],
DEFAULT 2025-12-13T22:48:25.665842Z safetySettings: undefined,
DEFAULT 2025-12-13T22:48:25.665847Z tools: [Array],
DEFAULT 2025-12-13T22:48:25.665890Z toolConfig: [Object],
DEFAULT 2025-12-13T22:48:25.665893Z cachedContent: undefined,
DEFAULT 2025-12-13T22:48:25.665897Z labels: undefined
DEFAULT 2025-12-13T22:48:25.665901Z },
DEFAULT 2025-12-13T22:48:25.665905Z statusCode: 404,
DEFAULT 2025-12-13T22:48:25.665908Z responseHeaders: {
DEFAULT 2025-12-13T22:48:25.665913Z 'alt-svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000',
DEFAULT 2025-12-13T22:48:25.665917Z 'content-length': '0',
DEFAULT 2025-12-13T22:48:25.665921Z 'content-type': 'text/html',
DEFAULT 2025-12-13T22:48:25.665925Z date: 'Sat, 13 Dec 2025 22:48:25 GMT',
DEFAULT 2025-12-13T22:48:25.665929Z server: 'scaffolding on HTTPServer2',
DEFAULT 2025-12-13T22:48:25.665933Z 'x-content-type-options': 'nosniff',
DEFAULT 2025-12-13T22:48:25.665936Z 'x-frame-options': 'SAMEORIGIN',
DEFAULT 2025-12-13T22:48:25.665940Z 'x-xss-protection': '0'
DEFAULT 2025-12-13T22:48:25.665944Z },
DEFAULT 2025-12-13T22:48:25.665947Z responseBody: '',
DEFAULT 2025-12-13T22:48:25.665951Z isRetryable: false,
DEFAULT 2025-12-13T22:48:25.665955Z data: undefined
DEFAULT 2025-12-13T22:48:25.665961Z },
DEFAULT 2025-12-13T22:48:25.665965Z runId: 'df3a8934-acdf-4658-ad92-6a74ccafc513'
DEFAULT 2025-12-13T22:48:25.665968Z }

The URL …/publishers/google/google/gemini-2.5-flash is pretty sus.

Metadata

Metadata

Assignees

Labels

playgroundApplies to Defang SaaS only

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions