We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 10c7285 commit 2379287Copy full SHA for 2379287
docs/llm/nemo_2/optimized/tensorrt-llm.md
@@ -284,7 +284,7 @@ python /opt/Export-Deploy/scripts/deploy/nlp/query.py --url "http://localhost:80
284
Please see the below if you would like to use APIs to send a query.
285
286
```python
287
-from nemo_deploy.nlp import NemoQueryLLM
+from nemo_deploy.llm import NemoQueryLLM
288
289
nq = NemoQueryLLM(url="localhost:8000", model_name="llama")
290
output = nq.query_llm(
0 commit comments