Skip to content

[Internal]: Document how to connect OSS model using vLLM #3474

@dhru42

Description

@dhru42

Description

What: We want to inform our customer how they can utilize vLLM to run OSS models similar to the instructions we published to use LMStudio.

Resources

Instructions are being finalized in the doc linked here.

Which documentation set does this change impact?

Elastic On-Prem and Cloud (all)

Feature differences

n.a

What release is this request related to?

N/A

Serverless release

n/a

Collaboration model

The documentation team

Point of contact.

Main contact: @dhru42 @jamesspi

Stakeholders: @jamesspi

Metadata

Metadata

Assignees

Labels

Team:ExperienceIssues owned by the Experience Docs Team

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions