Skip to content

InferencePool & EPP architecture clarity #1675

@srampal

Description

@srampal

Per community call discussion add some more clarity/ preciseness in the docs on topics such as

  1. InferencePool use for more than 1 base model type: when is it okay and when not okay
  2. EPP-like objects vs the reference EPP
  3. Additional related design preciseness

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions