Skip to content

Commit bc371de

Browse files
prashantgupta24njhill
authored andcommitted
🎨 add toc
Signed-off-by: Prashant Gupta <[email protected]>
1 parent b85eae9 commit bc371de

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

README.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,20 @@ A number of features here are similar/equivalent but are implemented differently
99
Some upstream changes were intentionally not pulled in because they weren't required for our current usage, for example OPT/Galactica model support. And we have stopped pulling in any upstream work after TGI version 1.0, following which the Apache 2.0 OSS license doesn't apply.
1010

1111
---
12+
### Table of contents
13+
14+
- [Some of the features in this repo not in HF TGI as of v1.0](#some-of-the-features-in-this-repo-not-in-hf-tgi-as-of-v10)
15+
- [Run the integration tests](#run-the-integration-tests)
16+
- [Build the final container image](#build-the-final-container-image)
17+
- [Deploy model in Kubernetes/OpenShift](#deploy-model-in-kubernetesopenshift)
18+
- [Model configuration](#model-configuration)
19+
- [Downloading model weights](#downloading-model-weights)
20+
- [Converting weights to `safetensors` format](#converting-weights-to-safetensors-format)
21+
- [Running sharded models (Tensor Parallel)](#running-sharded-models-tensor-parallel)
22+
- [TLS configuration](#tls-configuration)
23+
- [Metrics](#metrics)
1224

25+
---
1326
### Some of the features in this repo not in HF TGI as of v1.0
1427
- gRPC front-end interface instead of REST, different arrangement of API parameters
1528
- Support for batch inputs in the API

0 commit comments

Comments
 (0)