Skip to content

Commit a1e5e06

Browse files
authored
Update README.md
1 parent 665f463 commit a1e5e06

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,8 @@ GPRC is a framework for implementing Remote Procedure Call (RPC) via HTTP/2. Dev
110110
If you are happy to live with some lock-in, these are good options:
111111
* [Tensorflow serving](https://www.tensorflow.org/tfx/guide/serving) is limited to Tensorflow models
112112
* [TensorRT_Inference](https://github.com/lzh420202/TensorRT_Inference) -> An oriented object detection framework based on TensorRT
113-
* [Pytorch serve](https://github.com/pytorch/serve) is easy to use, limited to Pytorch models, and can be deployed via AWS Sagemaker, See [pl-lightning-torchserve-neptune-template](https://github.com/i008/pl-lightning-torchserve-neptune-template)
113+
* [torch serve](https://github.com/pytorch/serve) -> limited to Pytorch models, no longer maintained
114+
* [LitServe](https://github.com/Lightning-AI/LitServe) -> augments FastAPI with features like batching, streaming, and GPU autoscaling
114115
* [sagemaker-inference-toolkit](https://github.com/aws/sagemaker-inference-toolkit) -> Serve machine learning models within a Docker container using AWS SageMaker
115116

116117
## Framework agnostic model serving

0 commit comments

Comments
 (0)