Skip to content

Commit 4ac413b

Browse files
authored
Update diagram in inference doc (#3945)
The NJS model extraction module isn't needed at this time, so the diagram needs to be updated.
1 parent 24dee2b commit 4ac413b

File tree

1 file changed

+8
-10
lines changed

1 file changed

+8
-10
lines changed

docs/proposals/gateway-inference-extension.md

Lines changed: 8 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -76,20 +76,18 @@ flowchart TD
7676
A[Client Request] --> B[NGINX]
7777
subgraph NGINX Pod
7878
subgraph NGINX Container
79-
B --1--> C[NJS Module: extract model name if needed]
80-
C --2--> B
81-
B --3--> D[NJS Module: Subrequest to Go App]
79+
B --1--> C[NJS Module: Subrequest to Go App]
8280
end
8381
subgraph Go Application Container
84-
E[Go Application]
82+
D[Go Application]
8583
end
86-
D -- 4. subrequest --> E
84+
C -- 2. subrequest --> D
8785
end
88-
E -- 5. gRPC ext_proc protocol --> F[Endpoint Picker Pod]
89-
F -- 6. Endpoint in Header --> E
90-
E --7--> D
91-
D --8--> B
92-
B --9--> G[AI Workload Endpoint]
86+
D -- 3. gRPC ext_proc protocol --> E[Endpoint Picker Pod]
87+
E -- 4. Endpoint in Header --> D
88+
D --5--> C
89+
C --6--> B
90+
B --7--> F[AI Workload Endpoint]
9391
```
9492

9593
## API, Customer Driven Interfaces, and User Experience

0 commit comments

Comments
 (0)