Skip to content

Feature add: CLI commands #24

@DzmitryPihulski

Description

@DzmitryPihulski

Add cli commands for inference, something in syle: llmsql inference --method vllm/transformers --model hf_model_name --vllm_args ... --transformers AutoModel_args

Metadata

Metadata

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions