Skip to content

The Vertex AI Gemini should not retain GenerativeModel state between calls.  #560

@tzolov

Description

@tzolov

Current VertexAiGeminiChatClient leaks GenerativeModel state between the consecutive call and stream invocations.

Current behaviour: The this.generativeModel is created in the constructor and mutated during the invocations.

Expected behaviour: An unique GenerativeModel instance should be created for each invocation.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions