Udpate TorchServe example README

2noise · Jan 8, 2025 · 9bedaa1 · 9bedaa1
1 parent 0b5ff75
commit 9bedaa1
Show file tree

Hide file tree

Showing 2 changed files with 8 additions and 3 deletions.
diff --git a/examples/torchserve/README.md b/examples/torchserve/README.md
@@ -8,10 +8,10 @@ TorchServe is designed to deliver high performance for serving PyTorch models, a
 
 2. Horizontal Scaling: TorchServe allows for horizontal scaling, meaning it can easily scale across multiple machines or containers to handle increasing traffic. This ensures that the system remains responsive and can handle large volumes of inference requests without sacrificing performance.
 
-## Navigate to the examples/torchserve directory
+## Install requirements
 
 ``` bash
-cd examples/torchserve
+pip install -r requirements.txt
 ```
 
 ## Download the model if needed
@@ -49,7 +49,9 @@ The configuration properties that we are interested in are the following:
 ## Start TorchServe locally
 
 ``` bash
-torchserve --start --model-store model_store --models chattts=chattts.mar
+pip install ChatTTS nvgpu soundfile nemo_text_processing WeTextProcessing
+
+torchserve --start --model-store model_store --models chattts=chattts.mar  --ts-config config.properties
 ```
 
 ## Optional: Start TorchServe with docker

diff --git a/examples/torchserve/requirements.txt b/examples/torchserve/requirements.txt
@@ -0,0 +1,3 @@
+huggingface_hub[cli]
+torchserve
+torch-model-archiver