Skip to content

Commit ce84333

Browse files
Merge pull request #280506 from ssalgadodev/patch-124
Update deploy-models-llama.md
2 parents a0566c1 + 2a122fd commit ce84333

File tree

2 files changed

+34
-11
lines changed

2 files changed

+34
-11
lines changed

articles/ai-studio/how-to/deploy-models-llama.md

Lines changed: 17 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -537,14 +537,25 @@ For reference about how to invoke Llama models deployed to managed compute, see
537537

538538
##### More inference examples
539539

540+
# [Meta Llama 3](#tab/llama-three)
541+
542+
| **Package** | **Sample Notebook** |
543+
|----------------|----------------------------------------|
544+
| OpenAI SDK (experimental) | [openaisdk.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/openaisdk.ipynb) |
545+
| LangChain | [langchain.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/langchain.ipynb) |
546+
| WebRequests | [webrequests.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/webrequests.ipynb) |
547+
| LiteLLM SDK | [litellm.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/litellm.ipynb) |
548+
549+
# [Meta Llama 2](#tab/llama-two)
550+
540551
| **Package** | **Sample Notebook** |
541552
|----------------|----------------------------------------|
542-
| CLI using CURL and Python web requests - Command R | [command-r.ipynb](https://aka.ms/samples/cohere-command-r/webrequests)|
543-
| CLI using CURL and Python web requests - Command R+ | [command-r-plus.ipynb](https://aka.ms/samples/cohere-command-r-plus/webrequests)|
544-
| OpenAI SDK (experimental) | [openaisdk.ipynb](https://aka.ms/samples/cohere-command/openaisdk) |
545-
| LangChain | [langchain.ipynb](https://aka.ms/samples/cohere/langchain) |
546-
| Cohere SDK | [cohere-sdk.ipynb](https://aka.ms/samples/cohere-python-sdk) |
547-
| LiteLLM SDK | [litellm.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/cohere/litellm.ipynb) |
553+
| OpenAI SDK (experimental) | [openaisdk.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/openaisdk.ipynb) |
554+
| LangChain | [langchain.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/langchain.ipynb) |
555+
| WebRequests | [webrequests.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/webrequests.ipynb) |
556+
| LiteLLM SDK | [litellm.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/litellm.ipynb) |
557+
558+
---
548559

549560
## Cost and quotas
550561

articles/machine-learning/how-to-deploy-models-llama.md

Lines changed: 17 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -559,13 +559,25 @@ For reference about how to invoke Meta Llama 3 models deployed to real-time endp
559559

560560
#### Additional inference examples
561561

562+
# [Meta Llama 3](#tab/llama-three)
563+
562564
| **Package** | **Sample Notebook** |
563565
|----------------|----------------------------------------|
564-
| CLI using CURL and Python web requests | [cohere-embed.ipynb](https://aka.ms/samples/embed-v3/webrequests)|
565-
| OpenAI SDK (experimental) | [openaisdk.ipynb](https://aka.ms/samples/cohere-embed/openaisdk) |
566-
| LangChain | [langchain.ipynb](https://aka.ms/samples/cohere-embed/langchain) |
567-
| Cohere SDK | [cohere-sdk.ipynb](https://aka.ms/samples/cohere-embed/cohere-python-sdk) |
568-
| LiteLLM SDK | [litellm.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/cohere/litellm.ipynb) |
566+
| OpenAI SDK (experimental) | [openaisdk.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/openaisdk.ipynb) |
567+
| LangChain | [langchain.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/langchain.ipynb) |
568+
| WebRequests | [webrequests.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/webrequests.ipynb) |
569+
| LiteLLM SDK | [litellm.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/meta-llama3/litellm.ipynb) |
570+
571+
# [Meta Llama 2](#tab/llama-two)
572+
573+
| **Package** | **Sample Notebook** |
574+
|----------------|----------------------------------------|
575+
| OpenAI SDK (experimental) | [openaisdk.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/openaisdk.ipynb) |
576+
| LangChain | [langchain.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/langchain.ipynb) |
577+
| WebRequests | [webrequests.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/webrequests.ipynb) |
578+
| LiteLLM SDK | [litellm.ipynb](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/llama2/litellm.ipynb) |
579+
580+
---
569581

570582
## Cost and quotas
571583

0 commit comments

Comments
 (0)