Fixes #3824, 3849 - New Google Gen AI Embedding Module, Starters for GenAI and GenAI EMbedding Module and support for ThinkingBudget#3914
Closed
ddobrin wants to merge 5 commits intospring-projects:mainfrom
Closed
Conversation
…odule Signed-off-by: ddobrin <ddobrin@google.com>
…ess Google AI Embedding Models - text embeddings Signed-off-by: ddobrin <ddobrin@google.com>
…re-genai-embedding modules Signed-off-by: ddobrin <ddobrin@google.com>
Signed-off-by: ddobrin <ddobrin@google.com>
Signed-off-by: ddobrin <ddobrin@google.com>
Member
|
thank you very much! merged in 085446c |
Lewik
added a commit
to Lewik/gromozeka
that referenced
this pull request
Nov 7, 2025
…ound - Migrate to Spring AI snapshot 1.1.0-20251106.200546-785 with google-genai module - Add GoogleGenAiGeminiChatModelWithWorkarounds to fix two Spring AI limitations: 1. Extract thought summaries from Gemini API (Spring AI ignores thought parts) 2. Fix empty tool call IDs causing protobuf errors (inject UUIDs) - Override responseCandidateToGeneration() to manually process all part types - Override createGeminiRequest() to inject includeThoughts(true) via toBuilder() - Add usage logging for thinking tokens (GoogleGenAiUsage) - Update GeminiConfig with .vertexAI(true) for Vertex AI authentication - Migrate application.yaml from vertex-ai-gemini to google-genai configuration - Remove old VertexAiGeminiChatModelWithIdFix (replaced by unified workaround) Related issues: - spring-projects/spring-ai#4629 (empty tool call IDs) - spring-projects/spring-ai#3914 (thinking support PR) Thinking blocks now visible in UI with metadata["thinking"]=true protocol. Verified with 4 thinking blocks extracted and thoughts=490/300 tokens logged. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR introduces comprehensive support for Google's latest Unified SDK with text embedding capabilities and enhances the existing chat model functionality.
Key Changes:
New Google Gen AI Text Embedding Support (Support latest Google Unified SDK to access Google AI Embedding Models #3824)
- Added a new spring-ai-google-genai-embedding module with full text embedding model implementation
- Supports Google's text embedding models (text-embedding-005, text-embedding-004, gemini-embedding-001) with configurable options
- Includes comprehensive test coverage with retry logic and observability support
Spring Boot Starter for Google Gen AI (Support latest Google Unified SDK to access Google AI Embedding Models #3824)
- Created spring-ai-autoconfigure-model-google-genai module with auto-configuration for both chat and embedding models
- Provides property-based configuration for easy integration
- Includes migration guide and extensive integration tests
Thinking Configuration Support (Add Thinking Config and Content Caching to the Google Gen AI Module #3849)
- Enhanced Google Gen AI chat model with thinking/reasoning configuration in the spring-ai-google-genai module
- Added support for configurable thinking parameters in chat options
- Enables advanced reasoning capabilities in the chat model