You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/prompt-flow/concept-llmops-maturity.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,13 +16,13 @@ ms.date: 03/12/2024
16
16
17
17
Large Language Operations, or **LLMOps**, describes the operational practices and strategies for managing large language models (LLMs) in production. This article provides guidance on how to advance your capabilities in LLMOps, based on your organization's current maturity level.
18
18
19
-
:::image type="content" source="../media/concept-llmops-maturity/llmopsml.png" alt-text="Diagram shows maturity level of LLMOps":::
19
+
:::image type="content" source="../media/concept-llmops-maturity/llmopsml.png" alt-text="Diagram shows maturity level of LLMOps" lightbox="../media/concept-llmops-maturity/llmopsml.png":::
20
20
21
21
[**Start by answering this questionnaire**]() to assesses your organization's current LLMOps maturity level. The questionnaire is designed to help you understand your organization's current capabilities and identify areas for improvement.
22
22
23
23
Your results from the questionnaire corresponds to a *LLMOps Maturity Model* ranking level, providing a general understanding and practical application level of your organization. These guidelines provide you with helpful links to expand your LLMOps knowledge base.
**Description:** Your organization is at the initial foundational stage of LLMOps maturity. You're exploring the capabilities of LLMs but haven't yet developed structured practices or systematic approaches.
28
28
@@ -43,7 +43,7 @@ To better understand LLMOps, consider available MS Learning courses and workshop
43
43
-[***Microsoft Azure AI Fundaments: GenAI***](/training/paths/introduction-generative-ai/)
44
44
-[***GenAI for Beginners Course***](https://techcommunity.microsoft.com/t5/educator-developer-blog/generative-ai-for-beginners-a-12-lesson-course/ba-p/3968583)
45
45
46
-
## Level 2 - systemizing LLMops development
46
+
## <aname="level2"> Level 2 - systemizing LLMops development
47
47
48
48
**Description:** Your organization has started to systematize LLM operations, with a focus on structured development and experimentation. However, there's room for more sophisticated integration and optimization.
49
49
@@ -60,7 +60,7 @@ To improve your capabilities and skills, learn how to develop more complex promp
-[***Responsible AI Tools and Practices***](https://azure.microsoft.com/blog/infuse-responsible-ai-tools-and-practices-in-your-llmops/#:~:text=Azure%20AI%20offers%20robust%20tools,or%20build%20your%20own%20metrics)
**Description:** Your organization is managing advanced LLM workflows with proactive monitoring and structured deployment strategies. You're close to achieving operational excellence.
66
66
@@ -73,13 +73,13 @@ To expand your base knowledge, focus on continuous improvement and innovation in
73
73
-[***GenAI Model Monitoring***](/azure/machine-learning/prompt-flow/how-to-monitor-generative-ai-applications)
74
74
-[***Elevate LLM Apps to Production with LLMOps***](https://techcommunity.microsoft.com/t5/ai-machine-learning-blog/elevate-your-llm-applications-to-production-via-llmops/ba-p/3979114)
**Description:** Your organization demonstrates operational excellence in LLMOps. You have a sophisticated approach to LLM application development, deployment, and monitoring.
79
79
80
80
As LLMs evolve, you’ll want to maintain your cutting-edge position by staying updated with the latest LLM advancements. Continuously evaluate the alignment of your LLM strategies with evolving business objectives. Ensure that you foster a culture of innovation and continuous learning within your team. Last, but not least, share your knowledge and best practices with the wider community to establish thought leadership in the field.
81
81
82
82
### Suggested references for advanced techniques
83
83
84
-
-[***Azure AI Studio Model Catalog***](https://ai.azure.com/explore/models)
85
-
-[***Evaluation of GenAI applications***](/azure/ai-studio/concepts/evaluation-approach-gen-ai)
84
+
-[***Azure AI Studio Model Catalog***](https://ai.azure.com/explore/models)
85
+
-[***Evaluation of GenAI applications***](/azure/ai-studio/concepts/evaluation-approach-gen-ai)
0 commit comments