Skip to content

Conversation

@DzmitryPihulski
Copy link
Collaborator

Chat template handling added;

@DzmitryPihulski DzmitryPihulski self-assigned this Dec 1, 2025
@DzmitryPihulski DzmitryPihulski added bug Something isn't working enhancement New feature or request labels Dec 1, 2025
@DzmitryPihulski DzmitryPihulski linked an issue Dec 1, 2025 that may be closed by this pull request
@codecov
Copy link

codecov bot commented Dec 1, 2025

Codecov Report

❌ Patch coverage is 83.87097% with 5 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
llmsql/inference/inference_transformers.py 71.42% 4 Missing ⚠️
llmsql/inference/inference_vllm.py 94.11% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

Copy link
Collaborator

@ViktoriaNov ViktoriaNov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’ve reviewed the changes in this PR.
The additions to inference_transformers and inference_vllm are clear and well-structured.
The new parameters, especially chat template handling and llm_kwargs, are documented and examples updated.
Everything else looks good, ready for merge from my side.

@DzmitryPihulski DzmitryPihulski merged commit d8442db into main Dec 2, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add custom chat template handaling

3 participants