You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
and the [Gateway API](https://gateway-api.sigs.k8s.io/) subproject. These groups
14
19
are all well represented within the ownership of this project, and the separate
15
20
repo enables this group to iterate more quickly as this project is getting
16
-
started. As the project stabilizes, we'll revisit if it should become part of
21
+
started. As the project stabilizes, we'll revisit if it should become part of
17
22
the main Gateway API project.
18
23
19
24
## Will there be a default controller implementation?
20
25
No. Although this project will provide a default/reference implementation of an
21
26
extension, each individual Gateway controller can support this pattern. The
22
27
scope of this project is to define the API extension model, a reference
23
-
extension, conformance tests, and overall documentation.
28
+
extension, conformance tests, and overall documentation.
29
+
30
+
A default controller for CRDs that do not have a Gateway dependency may be considered in the future.
24
31
25
-
## Can you add support for my use case to the reference extension?
26
-
Maybe. We're trying to keep the scope of the reference extension fairly narrow
27
-
and instead hoping to see an ecosystem of compatible extensions developed in
28
-
this space. Unless a use case fits neatly into the existing scope of our
29
-
reference extension, it would likely be better to develop a separate extension
30
-
focused on your use case.
32
+
## Can you add support for my use case?
33
+
Definitely. We are always happy to accept proposals to improving inference capabilities! However, the extensible and pluggable architecture of the EPP allows you to add it yourself, benchmark the capabilities, and then share those with the community. If you are looking for a place for more experimental features, [llm-d](https://github.com/llm-d) is a great place for incubation, many ideas and optimizations that start there, graduate to this repo. Additionally, many of us that work on this project, work there as well!
0 commit comments