Skip to content

Commit 5fd7b3e

Browse files
authored
pull base content,head:MicrosoftDocs:main,into:wwlpublishsync
2 parents 9ed4698 + 44f5734 commit 5fd7b3e

34 files changed

+1291
-0
lines changed
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.introduction-generative-ai-center-excellence
3+
title: Introduction to the Generative AI Center of Excellence
4+
metadata:
5+
title: Introduction to the Generative AI Center of Excellence
6+
description: Introduction to the Generative AI Center of Excellence
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 5
12+
content: |
13+
[!include[](includes/1-introduction-generative-ai-center-excellence.md)]
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.how-center-excellence-assists-planning-adoption-generative-ai
3+
title: How the Generative AI CoE assists in planning adoption of generative AI
4+
metadata:
5+
title: How the Generative AI CoE assists in planning adoption of generative AI
6+
description: Learn how the Generative AI CoE assists in planning adoption of generative AI.
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 5
12+
content: |
13+
[!include[](includes/2-how-center-excellence-assists-planning-adoption-generative-ai.md)]
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.oversight-generative-ai-deployment-operations-governance
3+
title: Oversight of generative AI deployment, operations, and governance.
4+
metadata:
5+
title: Oversight of generative AI deployment, operations, and governance.
6+
description: Understanding the generative AI CoE's role in oversight of generative AI deployment, operations, and governance.
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 6
12+
content: |
13+
[!include[](includes/3-oversight-generative-ai-deployment-operations-governance.md)]
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.determining-organizational-roles-responsibilities
3+
title: Determining organizational roles and responsibilities
4+
metadata:
5+
title: Determining organizational roles and responsibilities
6+
description: Understand the roles and responsibilities of a Generative AI Center of Excellence.
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 6
12+
content: |
13+
[!include[](includes/4-determining-organizational-roles-responsibilities.md)]
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.skilling-your-organization
3+
title: Skilling your organization
4+
metadata:
5+
title: Skilling your organization
6+
description: Learn how the Generative AI CoE helps skilling your organization.
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 2
12+
content: |
13+
[!include[](includes/5-skilling-your-organization.md)]
Lines changed: 47 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.knowledge-check
3+
title: Knowledge Check
4+
metadata:
5+
title: Knowledge Check
6+
description: Validate your understanding of the Generative AI Center of Excellence.
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 3
12+
content: Choose the best response for each question.
13+
quiz:
14+
questions:
15+
- content: "What is a primary responsibility of a Generative AI Center of Excellence?"
16+
choices:
17+
- content: "Developing custom LLM models for all organizational needs."
18+
isCorrect: false
19+
explanation: "While the CoE may provide guidance on AI development, developing custom LLMs isn't a primary responsibility. A generative AI CoE can focus on execution responsibilities like developing models or serve as a guiding body."
20+
- content: "Aligning generative AI initiatives with organizational and business priorities."
21+
isCorrect: true
22+
explanation: "One of the key responsibilities of an AI CoE, is aligning generative AI initiatives with organizational and business priorities."
23+
- content: "Replacing existing security teams with AI specialists."
24+
isCorrect: false
25+
explanation: "The CoE should work 'in close and constant collaboration' with security teams rather than replacing them."
26+
- content: "Which of the following best describes how a generative AI CoE approaches cost management?"
27+
choices:
28+
- content: "By focusing exclusively on using open-source models to minimize expenses."
29+
isCorrect: false
30+
explanation: "Organizations should assess factors such as 'cost integration complexity and adaptability' when making decisions between custom solutions and off-the-shelf alternatives."
31+
- content: "By promoting FinOps principles and collaboration between finance, engineering, and business teams."
32+
isCorrect: true
33+
explanation: "The CoE contributes to cost efficiency by promoting FinOps principles, driving collaboration between finance, engineering, and business teams."
34+
- content: "By centralizing all AI development to avoid departmental duplication."
35+
isCorrect: false
36+
explanation: "Execution is often decentralized, especially in larger organizations."
37+
- content: "Which role is designs and optimizes inputs for generative AI models to guide their behavior?"
38+
choices:
39+
- content: "AI Agent Engineer"
40+
isCorrect: false
41+
explanation: "AI Agent Engineers develop 'autonomous AI systems that can perceive, reason, and act to achieve specific goals' rather than focusing on prompt design."
42+
- content: "Generative AI Operations"
43+
isCorrect: false
44+
explanation: "Operations are responsible for 'deploying, managing, monitoring, backup, and recovery of AI workloads' rather than prompt design."
45+
- content: "Prompt Engineer"
46+
isCorrect: true
47+
explanation: "Prompt engineers 'design and optimizes inputs for generative AI models to guide their behavior and produce accurate, desired outputs.'"
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
### YamlMime:ModuleUnit
2+
uid: learn.introduction-generative-ai-center-excellence.summary
3+
title: Summary
4+
metadata:
5+
title: Summary
6+
description: A summary of the module.
7+
ms.date: 04/05/2025
8+
author: Orin-Thomas
9+
ms.author: orthomas
10+
ms.topic: unit
11+
durationInMinutes: 2
12+
content: |
13+
[!include[](includes/7-summary.md)]
Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,32 @@
1+
A generative AI CoE is a collection of people and resources that help an organization adopt generative AI. It helps define an organization's strategy, determining and establishing an organization's best practices for generative AI, and acts as an organization's generative AI adoption knowledge and skilling hub.
2+
3+
## What are the functions of a generative AI CoE?
4+
5+
A generative AI CoE typically focuses on setting direction, defining strategies, providing support, establishing metrics, and monitoring the impact of generative AI initiatives. A generative AI CoE provides an organization with a central location and set of people that have the knowledge, skills, and capabilities to effectively leverage AI. When properly implemented, a generative AI CoE holds the authority and influence within an organization needed to drive adoption of generative AI solutions.
6+
7+
A generative AI CoE assists an organization with:
8+
9+
- Determining business use cases for generative AI applications.
10+
- Organizational generative AI readiness and driving adoption.
11+
- Developing generative AI skilling resources.
12+
- Identifying roles required for generative AI adoption and success.
13+
- Ensuring that generative AI workloads are governed responsibly and are compliant.
14+
- Ensuring that generative AI workloads meet operations and security best practices.
15+
16+
## Tailoring a generative AI CoE to your organization's needs
17+
18+
When designing and implementing a generative AI CoE, consider the following questions:
19+
20+
- Should the generative AI CoE concentrate on technical and operational aspects, on strategy and business alignment, or adopt an integrated approach?
21+
- Should the CoE focus on execution responsibilities like developing LLM models or serve as a guiding body, setting principles and frameworks?
22+
- Should the organization create an independent team associated with the CoE or can the necessary generative AI expertise be embedded within existing teams?
23+
- Should the CoE operate as a centralized entity, a decentralized network, or a hybrid model?
24+
- Which staff should be part of the CoE to ensure its effectiveness?
25+
- Should the CoE primarily serve internal teams, support external clients, or focus on partners and ecosystem collaboration?
26+
- If the CoE is internally focused, does it also deliver AI services to the market as part of the organization's business model, or is it strictly enabled for internal AI adoption?
27+
28+
Choosing the right organizational model depends on several factors. A CoE will always require some level of centralization to support governance, best practices, and alignment across all generative AI initiatives. However, execution is often decentralized, especially in larger organizations or industries where AI adoption varies across departments.
29+
30+
Organizations needing greater control, compliance, and standardization might prefer a centralized model. In contrast, more distributed organizations, where business units operate independently, may opt for a hybrid approach, with the CoE providing strategic oversight while allowing departmental or regional execution.
31+
32+
Small and medium enterprises may choose to start small and then scale. This allows those enterprises to focus on specific use cases where generative AI can immediately add business value. Small and medium enterprises may even partner with consultants to implement a virtual generative AI CoE if expertise isn't available within the organization itself.
Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
IT projects suffer from many risks including scope creep, missing completion deadlines, and the project exceeding allocated budget. Projects that are planned out and which include best practices from the beginning are more likely to achieve their goals, be deployed within the projected timeframe, and remain within projected costs than those projects that take a more exploratory approach. A properly constituted generative AI CoE helps an organization minimize the chance that generative AI projects are unsuccessful and that the projects meet organizational aspirations.
2+
3+
A generative AI CoE can influence all of an organization's generative AI projects with the aim of all of those projects being successful and driving value for the business.
4+
5+
## Estimates of business value
6+
7+
A strong reason for organizations to consider adopting a generative AI CoE is that the structured approach that a properly functioning generative AI CoE brings helps an organization reap the strongest benefits from generative AI adoption.
8+
9+
When implemented correctly, an AI center of excellence ensures the right people are involved at the right time. Key responsibilities of the AI CoE include:
10+
11+
- Aligning AI initiatives with organizational and business priorities.
12+
- Measuring and communicating the impact of these initiatives.
13+
- Promoting and overseeing leaders' alignment and commitment.
14+
- Raising awareness and understanding of generative AI within the organization to drive adoption and build capabilities.
15+
- Ensuring key business and technical decision-makers, and other stakeholders, are actively involved in generative AI initiatives.
16+
- Bridging the gap between technical and leadership to translate technical capabilities into business outcomes.
17+
18+
![Diagram showing the process through which technical and domain experts can collaborate in generative AI lifecycle.](../media/technical-domain-expert-collaboration.png)
19+
20+
A generative AI CoE is able to identify use cases and ensure the "organizational fit." Domain experts (from business or specific functions) play a crucial role in identifying relevant use cases, determining the necessary data, and evaluating the model's effectiveness, especially considering the unique challenges of generative AI like delusions or model variability. The CoE is able to ensure that use cases must align with the organization's overarching strategy and its ability to deliver on that strategy.
21+
22+
## Realistic estimates of outcomes
23+
24+
A generative AI CoE can also ensure that an assessment is performed of how realistic the goals of a generative AI project are before a line of code has been deployed, rather than determining that the goals weren't realistic only after the project fails to meet expectations. Implementing generative AI in an organization requires a clear approach to measure its performance, adoption, and impact.
25+
26+
Without actionable metrics, it's challenging to evaluate progress, identify improvement areas, or manage complexity. A solid strategy depends on well-defined metrics to assess performance and ensure initiatives provide value. A generative AI CoE can be responsible for tracking these metrics to ensure that organizational objectives are achieved.
27+
28+
Beyond business outcomes, it's crucial to track how effectively generative AI is being adopted within the organization. Metrics like user engagement, frequency of usage, and integration with existing workflows can reveal valuable insights into the user experience and identify areas for improvement.
29+
30+
Transparent performance metrics developed by a generative AI CoE based on organizational expectations also increase organizational confidence in AI by demonstrating its real-world impact. Establishing clear links between AI performance and business outcomes strengthens stakeholder trust and reduces adoption barriers in future generative AI projects.
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
Infrastructure management is a critical component of adopting any IT solution. Poorly managed infrastructure can lead to inefficiencies, higher costs, and operational risks. If the infrastructure for generative AI is over-provisioned or poorly managed, the organization that owns pays the costs of that infrastructure risks having the financial benefits of adopting generative AI diminished by the costs associated with hosting generative AI solutions.
2+
3+
## Specifying generative AI best practices
4+
5+
When implementing a generative AI CoE, you can ensure that the generative AI CoE is required to determine what best generative AI adoption practices will be followed prior to those solutions are deployed in the organization's infrastructure environment. A properly constituted generative AI CoE can also determine appropriate oversight mechanisms for the deployment and operation of the solution. Not only can oversight mechanisms and the implementation of best practices instituted from generative AI workload conception optimize costs, but they can also help ensure that a generative AI deployment complies with the regulatory requirements relevant to the organization.
6+
7+
## Security
8+
9+
As organizations integrate generative AI into their workflows, they must account for risks related to data protection, model security, compliance, adversarial attacks, and responsible AI governance. Security isn't a standalone function, but an essential component of every generative AI deployment.
10+
11+
While each generative AI solution incorporates security in different ways, a generative AI CoE plays an important role in setting guidelines and supporting teams in secure AI implementation. Rather than replacing dedicated security teams, the CoE needs to be in close and constant collaboration with them, to help embed security considerations into AI-related processes and align them with organizational security policies.
12+
13+
## Determining governance requirements
14+
15+
Governance is the critical backbone supporting the consistent application of responsible AI principles and practices across an organization. It involves setting company-wide rules, defining processes, and establishing roles for the stakeholders involved in the AI lifecycle.
16+
17+
Responsible AI governance bodies need sufficient financial resources, human capital, and authority to enact meaningful changes across the organization, ensuring responsible AI practices are both actionable and sustainable.
18+
19+
The generative AI CoE should be an integral part of the governance model, strengthening responsible AI through its practices. This includes skilling, development, deployment, monitoring strategies, and data management frameworks.
20+
21+
The CoE plays a critical role in providing AI-specific data standards and best practices while collaborating with specialized teams responsible for broader data governance and architecture. Additionally, generative AI systems often handle sensitive and regulated data, requiring organizations to comply with standards like GDPR, HIPAA, and CCPA. Implementing robust data security, privacy, and responsible AI practices help mitigate risks while fostering trust in AI-driven decisions.
22+
23+
## Cost management
24+
25+
Managing the financial impact of generative AI systems requires a structured approach to optimize costs while maintaining performance and scalability. Generative AI solutions often involve high computational and storage expenses, making cost control a critical aspect of operational success.
26+
27+
This practice establishes processes and tools to monitor, forecast, and optimize spending, ensuring that resources are efficiently allocated to maximize ROI. A key consideration in cost efficiency is determining whether to develop custom generative AI solutions or leverage off-the-shelf alternatives. Organizations must assess factors such as cost integration, complexity, and adaptability to make informed investment decisions.
28+
29+
A generative AI CoE can contribute to cost efficiency by promoting FinOps principles, driving collaboration between finance, engineering, and business teams to ensure that financial considerations are integrated into every stage of generative AI solution development and deployment.
30+
31+
## Monitoring and optimization
32+
33+
Effective measurement is crucial for selecting and optimizing generative AI models. Accurately interpreting metrics and benchmarks ensures meaningful AI evaluation, helping organizations choose the right models based on factors like accuracy, efficiency, and relevance to their use cases.
34+
35+
Selecting the appropriate model from the generative AI catalog requires understanding how different benchmarks align with real-world application needs.
36+
37+
This includes using metrics to assess and mitigate biases in the models, ensuring fairness and ethical outcomes. These metrics can help organizations identify models that aren't only effective but also aligned with responsible AI principles. Organizations should establish a system for continuous monitoring and improvement, using metrics to set baselines, track progress, and identify areas for refinement.

0 commit comments

Comments
 (0)