Skip to content

Feature/ucl alternate prompting#33

Open
antmikinka wants to merge 2 commits intomainfrom
feature/ucl-alternate-prompting
Open

Feature/ucl alternate prompting#33
antmikinka wants to merge 2 commits intomainfrom
feature/ucl-alternate-prompting

Conversation

@antmikinka
Copy link
Contributor

No description provided.

antmikinka and others added 2 commits March 6, 2026 12:12
- Change default modelName from gpt-oss-mxp4 to Qwen3-Coder-30B-A3B-Instruct-GGUF
- Update extractionModelName to match
- Include pending UI changes from main.tsx

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
Problem:
- StructuredExtractionService was ignoring extractionModel parameter
- LemonadeClient always used settings.modelName regardless of task
- Small models (Llama-3.2-1B) were failing on extraction tasks
- Job detail extraction was returning empty template instead of data

Solution:
- Add optional 'model' parameter to LemonadeClient.sendMessage()
- Pass extractionModel to all sendMessage calls in StructuredExtractionService
- Now extraction tasks use the configured extractionModelName
- With Qwen3-Coder-30B-A3B-Instruct-GGUF, extractions should succeed

Files changed:
- LemonadeClient.ts: Accept model override in sendMessage options
- StructuredExtractionService.ts: Use extractionModel for all requests

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant