feat(Add Gemma 4): profile support while keeping Qwen default#855
Merged
Lightheartdevs merged 3 commits intoLight-Heart-Labs:mainfrom Apr 8, 2026
Merged
Conversation
Lightheartdevs
approved these changes
Apr 8, 2026
Collaborator
Lightheartdevs
left a comment
There was a problem hiding this comment.
APPROVE. Clean profile system layered on existing tier architecture. Default is qwen — no change for existing installs. All HuggingFace URLs verified. 9 new BATS tests covering all profile/tier combinations. CI all green. Minor: GGUF_SHA256 empty for Gemma 4 entries (track as follow-up).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
What Changed
MODEL_PROFILEsupport forqwen,gemma4, andautoqwenas the default profile for new installs and existing installs that do not opt inautoavailable as an opt-in profile that can prefer Gemma 4 on stronger tiers while retaining Qwen fallback for the lightest tierTier Behavior
Default behavior:
MODEL_PROFILEis explicitly changedOpt-in behavior:
MODEL_PROFILE=gemma4enables Gemma 4 tier mappings directlyMODEL_PROFILE=autokeeps Qwen on the lightest tier and cloud tier, and prefers Gemma 4 on stronger local tiersGemma 4 safety tuning:
gemma-4-26b-a4b-itgemma-4-31b-itSH_COMPACTalso uses a safer context limit for the Gemma 4 pathNV_ULTRAandSH_LARGEkeep the longest context configurationWhy
This keeps DreamServer stable for current users while preparing the project for broader model-family support.
Instead of replacing the current Qwen defaults, this PR makes Gemma 4 available as an additional supported path and lays the groundwork for future inference-backend improvements, including newer upstream runtime support and potential TurboQuant-ready backend adoption as those dependencies mature.
Validation
bash tests/test-tier-map.shtests/bats/bats-core/bin/bats tests/bats-tests/tier-map.batsbash -n installers/lib/tier-map.shbash -n installers/macos/lib/tier-map.shbash -n installers/phases/02-detection.shbash -n installers/phases/06-directories.shbash -n installers/phases/08-images.shbash -n installers/macos/install-macos.shbash -n scripts/detect-hardware.shNotes