You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
description: Learn about the content credentials feature, which lets you verify that an image was generated by an AI model.
4
+
description: Learn about the Content Credentials feature, which lets you verify that an image was generated by an AI model.
5
5
author: PatrickFarley
6
6
ms.author: pafarley
7
7
ms.service: azure-ai-openai
8
8
ms.topic: conceptual
9
-
ms.date: 8/28/2024
9
+
ms.date: 02/20/2025
10
10
manager: nitinme
11
11
---
12
12
13
13
# Content Credentials
14
14
15
-
With the improved quality of content from generative AI models, there is an increased need for more transparency on the origin of AI-generated content. All AI-generated images from Azure OpenAI Service now include Content Credentials, a tamper-evident way to disclose the origin and history of content. Content Credentials are based on an open technical specification from the [Coalition for Content Provenance and Authenticity (C2PA)](https://www.c2pa.org), a Joint Development Foundation project.
15
+
With the improved quality of content from generative AI models, there is an increased need for more transparency about the origin of AI-generated content. All AI-generated images from Azure OpenAI Service include Content Credentials, a tamper-evident way to disclose the origin and history of content. Content Credentials are based on an open technical specification from the [Coalition for Content Provenance and Authenticity (C2PA)](https://www.c2pa.org), a Joint Development Foundation project.
16
16
17
17
## What are Content Credentials?
18
18
@@ -29,21 +29,18 @@ The manifest contains several key pieces of information:
29
29
30
30
Content Credentials in the Azure OpenAI Service can help people understand when visual content is AI-generated. For more information on how to responsibly build solutions with Azure OpenAI Service image-generation models, visit the [Azure OpenAI transparency note](/legal/cognitive-services/openai/transparency-note?tabs=text).
31
31
32
-
## How do I leverage Content Credentials in my solution today?
32
+
## How do I use Content Credentials in my solution today?
33
33
34
-
Customers may leverage Content Credentials by:
34
+
Customers may use Content Credentials by:
35
35
- Ensuring that their AI generated images contain Content Credentials
36
-
37
-
No additional set-up is necessary. Content Credentials are automatically applied to all generated images from DALL·E in the Azure OpenAI Service.
38
-
36
+
No additional set-up is necessary. Content Credentials are automatically applied to all generated images from DALL·E in the Azure OpenAI Service.
39
37
- Verifying that an image has Content Credentials
40
-
41
-
There are two recommended ways today to check the Credential of an image generated by Azure OpenAI DALL-E models:
42
-
43
-
1.**Content Credentials Verify webpage (contentcredentials.org/verify)**: This is a tool that allows users to inspect the Content Credentials of a piece of content. If an image was generated by DALL-E in Azure OpenAI, the tool will display that its Content Credentials were issued by Microsoft Corporation alongside the date and time of issuance.
44
-
45
-
:::image type="content" source="../media/encryption/credential-check.png" alt-text="Screenshot of the content credential verification website.":::
38
+
There are two recommended ways today to check the credential of an image generated by Azure OpenAI DALL-E models:
46
39
47
-
This page shows that an image generated by Azure OpenAI DALL-E has Content Credentials issued by Microsoft.
40
+
-**Content Credentials Verify webpage (contentcredentials.org/verify)**: This is a tool that allows users to inspect the Content Credentials of a piece of content. If an image was generated by DALL-E in Azure OpenAI, the tool will display that its Content Credentials were issued by Microsoft Corporation alongside the date and time of issuance.
41
+
:::image type="content" source="../media/encryption/credential-check.png" alt-text="Screenshot of the content credential verification website.":::
48
42
49
-
2.**Content Authenticity Initiative (CAI) open-source tools**: The CAI provides multiple open-source tools that validate and display C2PA Content Credentials. Find the tool right for your application and [get started here](https://opensource.contentauthenticity.org/).
43
+
This page shows that an image generated by Azure OpenAI DALL-E has Content Credentials issued by Microsoft.
44
+
45
+
-**Content Authenticity Initiative (CAI) open-source tools**: The CAI provides multiple open-source tools that validate and display C2PA Content Credentials. Find the tool right for your application and [get started here](https://opensource.contentauthenticity.org/).
description: Learn about the default content safety policies that Azure OpenAI uses to flag content.
4
+
description: Learn about the default content safety policies that Azure OpenAI uses to flag content and ensure responsible use of the service.
5
5
author: PatrickFarley
6
6
ms.author: pafarley
7
7
ms.service: azure-ai-openai
8
-
ms.topic: conceptual
9
-
ms.date: 07/15/2024
8
+
ms.topic: conceptual
9
+
ms.date: 02/20/2025
10
10
manager: nitinme
11
11
---
12
12
13
13
# Default content safety policies
14
14
15
15
16
-
Azure OpenAI Service includes default safety applied to all models, excluding Azure OpenAI Whisper. These configurations provide you with a responsible experience by default, including [content filtering models](/azure/ai-services/openai/concepts/content-filter?tabs=warning%2Cpython-new), blocklists, prompt transformation, [content credentials](/azure/ai-services/openai/concepts/content-credentials), and others.
16
+
Azure OpenAI Service includes default safety policies applied to all models, excluding Azure OpenAI Whisper. These configurations provide you with a responsible experience by default, including [content filtering models](/azure/ai-services/openai/concepts/content-filter?tabs=warning%2Cpython-new), blocklists, prompt transformation, [content credentials](/azure/ai-services/openai/concepts/content-credentials), and others.
17
17
18
-
Default safety aims to mitigate risks such as hate and fairness, sexual, violence, self-harm, protected material content and user prompt injection attacks. To learn more about content filtering, visit our documentation describing categories and severity levels[here](/azure/ai-services/openai/concepts/content-filter?tabs=warning%2Cpython-new).
18
+
Default safety aims to mitigate risks in different categories such as hate and fairness, sexual, violence, self-harm, protected material content, and user prompt injection attacks. To learn more about content filtering, visit our documentation describing [categories and severity levels](/azure/ai-services/openai/concepts/content-filter?tabs=warning%2Cpython-new).
19
19
20
-
All safety is configurable. To learn more about configurability, visit our documentation on [configuring content filtering](/azure/ai-services/openai/how-to/content-filters).
20
+
All safety policies are configurable. To learn more about configurability, see the documentation on [configuring content filtering](/azure/ai-services/openai/how-to/content-filters).
21
21
22
-
## Text models: GPT-4, GPT-3.5
22
+
## Text models
23
23
24
-
Text models in the Azure OpenAI Service can take in and generate both text and code. These models leverage Azure’s text content filtering models to detect and prevent harmful content. This system works on both prompt and completion.
24
+
Text models in the Azure OpenAI Service can take in and generate both text and code. These models leverage Azure’s text content filters to detect and prevent harmful content. This system works on both prompts and completions.
Copy file name to clipboardExpand all lines: articles/ai-services/openai/concepts/gpt-4-v-prompt-engineering.md
+11-12Lines changed: 11 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,28 +6,27 @@ author: PatrickFarley
6
6
ms.author: pafarley
7
7
ms.service: azure-ai-openai
8
8
ms.topic: conceptual
9
-
ms.date: 06/10/2024
9
+
ms.date: 02/20/2025
10
10
manager: nitinme
11
11
---
12
12
13
13
# Image prompt engineering techniques
14
14
15
15
To unlock the full potential of vision-enabled chat models like GPT-4 Turbo with Vision and GPT-4o, it's essential to tailor the prompts to your specific needs. Here are some guidelines to enhance the accuracy and efficiency of your prompts.
16
16
17
-
## Fundamentals of crafting your image prompt
17
+
## Fundamentals of writing an image prompt
18
+
18
19
-**Contextual specificity:** Adding context to the scenario at hand gives the model a better understanding of an appropriate output. This level of specificity aids in focusing on relevant aspects and avoiding extraneous details.
19
20
-**Task-oriented prompts:** Focusing on a specific task helps the model to develop the output while taking that perspective into consideration.
20
-
-**Handling refusals:** When the model indicates an inability to perform a task, refining the prompt can be an effective solution. More specific prompts can guide the model towards a clearer understanding and better execution of the task. Some tips to keep in mind:
21
-
21
+
-**Handle refusals:** When the model indicates an inability to perform a task, refining the prompt can be an effective solution. More specific prompts can guide the model towards a clearer understanding and better execution of the task. Keep these tips in mind:
22
22
- Request explanations for generated responses to enhance transparency in the model's output <br>
23
23
- If using a single-image prompt, place the image before the text <br>
24
24
- Ask the model to describe the image in details first and complete your specific task from the description
25
-
26
-
-**Adding examples:** Add examples that represent the type of responses you're looking for
25
+
-**Add examples:** Add examples that represent the type of responses you're looking for
27
26
-**Break down requests:** Try breaking down complex requests step-by-step to create manageable sub-goals
28
27
-**Define output format:** Clearly mention the desired format for the output, such as markdown, JSON, HTML, etc. You can also suggest a specific structure, length, or specific attributes about the response.
29
28
30
-
## Example prompt inputs & outputs
29
+
## Example prompt inputs and outputs
31
30
There are many ways to craft system prompts to tailor the output specifically to your needs. The following sample inputs and outputs showcase how adjusting your prompts can give you different results. Try out the model for yourself using these images and adjusting the system prompt in the [Azure AI Foundry playground](https://ai.azure.com/).
32
31
33
32
### Contextual specificity
@@ -62,7 +61,7 @@ When you receive a refusal output from a model, there are several ways you can t
62
61
63
62
|Follow up prompt|Model output|
64
63
|--------|-----------|
65
-
| What information do you need? |`I apologize for the confusion earlier. To plan a meal based on the image provided, I would need to know the following: <br> The number of people dining to ensure there's enough food for everyone.<br>Any dietary restrictions or preferences to accommodate (e.g., vegetarian, gluten-free, allergies).<br>The occasion or type of meal being planned (e.g., casual lunch, dinner party).<br>Desired balance of the meal in terms of food groups and nutrition. <br>With this information, I could help suggest how to portion the dishes, create a balanced meal, and ensure the meal meets the needs of all diners.`|
64
+
| What information do you need? |`I apologize for the confusion earlier. To plan a meal based on the image provided, I would need to know the following: `<br> `The number of people dining to ensure there's enough food for everyone.`<br>`Any dietary restrictions or preferences to accommodate (e.g., vegetarian, gluten-free, allergies).`<br>`The occasion or type of meal being planned (e.g., casual lunch, dinner party).`<br>`Desired balance of the meal in terms of food groups and nutrition.` <br>`With this information, I could help suggest how to portion the dishes, create a balanced meal, and ensure the meal meets the needs of all diners.`|
66
65
67
66
### Adding examples
68
67
@@ -74,17 +73,17 @@ When you receive a refusal output from a model, there are several ways you can t
74
73
|--------|-----------|
75
74
| Q: What is this dog breed and what is its average weight & height? :::image type="content" source="../media/concepts/gpt-v/pomeranian.jpg" lightbox="../media/concepts/gpt-v/pomeranian.jpg" alt-text="Photograph of a pomeranian dog sitting on a pool diving board above the water."::: <br> A: Breed: pomeranian; average weight: 3-7 lbs; average height: 8-14 inches <br> :::image type="content" source="../media/concepts/gpt-v/bulldog.jpg" lightbox="../media/concepts/gpt-v/bulldog.jpg" alt-text="Photograph of a bulldog laying in a grass field."::: A: Breed: English bulldog; average weight: 50-55 lbs; average height: 14-16 inches :::image type="content" source="../media/concepts/gpt-v/border-collie.jpg" lightbox="../media/concepts/gpt-v/border-collie.jpg" alt-text="Photograph of a border collie dog laying in a grass field."::: |`A: Breed: Border Collie; average weight: 30-45 lbs; average height: 18-22 inches`|
76
75
77
-
### Break down requests
76
+
### Breaking down requests
78
77
79
78
|Basic prompt|Model output|
80
79
|--------|-----------|
81
-
| :::image type="content" source="../media/concepts/gpt-v/grandmas-recipe.jpg" lightbox="../media/concepts/gpt-v/grandmas-recipe.jpg" alt-text="Photograph of a recipe card detailing a recipe for Grandma's Apple Crumb Pie."::: What's in this image? |`The image contains a recipe card titled Grandma's Apple Crumb Pie. It is noted as a Thanksgiving tradition. The ingredients listed are:<br><ul><li>5-7 apples, peeled </li> <li>1 9-inch pie crust</li> <li> 3/4 cups sugar </li> <li>1/2 teaspoon cinnamon </li> <li>A dash of salt </li><li> 3 tablespoons butter</li> </ul><br>Please note that the measurements for sugar, flour, and butter are not fully visible in the image. If needed, the standard measures for a crumb topping typically involve a combination of sugar, flour, and butter mixed together until crumbly`|
80
+
| :::image type="content" source="../media/concepts/gpt-v/grandmas-recipe.jpg" lightbox="../media/concepts/gpt-v/grandmas-recipe.jpg" alt-text="Photograph of a recipe card detailing a recipe for Grandma's Apple Crumb Pie."::: What's in this image? |`The image contains a recipe card titled Grandma's Apple Crumb Pie. It is noted as a Thanksgiving tradition. The ingredients listed are:`<br><ul><li>`5-7 apples, peeled `</li> <li>`1 9-inch pie crust`</li> <li>` 3/4 cups sugar `</li> <li>`1/2 teaspoon cinnamon `</li> <li>`A dash of salt `</li><li>` 3 tablespoons butter`</li> </ul><br>`Please note that the measurements for sugar, flour, and butter are not fully visible in the image. If needed, the standard measures for a crumb topping typically involve a combination of sugar, flour, and butter mixed together until crumbly`|
82
81
83
82
|Updated prompt|Model output|
84
83
|----------|-----------|
85
-
| :::image type="content" source="../media/concepts/gpt-v/grandmas-recipe.jpg" lightbox="../media/concepts/gpt-v/grandmas-recipe.jpg" alt-text="Photograph of a recipe card detailing a recipe for Grandma's Apple Crumb Pie."::: You are an AI assistant that helps create shopping lists and instructions to prep food based on recipes. Please provide a list of ingredients to purchase, and then provide a list of instructions to prep the ingredients based on the recipe card. | Sure, here's a shopping list based on the recipe card: <br>Shopping List:</br><ol><li>5-7 apples (suitable for baking, such as Granny Smith or Honeycrisp)</li> <li>1 ready-made pie crust (9-inch) </li><li>Sugar (ensure you have enough for 1/2 cup)</li><li>All-purpose flour (ensure you have enough for 3/4 cup)</li><li>Ground cinnamon</li><li>Salt</li><li>Butter (ensure you have enough for 3 tablespoons)</li></ol><br>Prepping Instructions:</br> <ul><li>Peel the apples: Using a vegetable peeler or a paring knife, remove the skin from 5 to 7 apples.</li><li>Core and slice the apples: Cut the apples into quarters, remove the cores, and then slice the apple quarters into thin slices or chunks, depending on your preference for pie texture.</li><li>Measure the ingredients: Measure out 3/4 cups of sugar, 1/2 teaspoon of cinnamon, a dash of salt (about 1/8 teaspoon), and 3 tablespoons of butter.</li><li>Prepare the butter: Cut the butter into small pieces to be ready to use in the recipe. It's often easier to incorporate if it's cold, so keep it refrigerated until it's needed</li><li>Preheat your oven according to the pie recipe's instructions so it's ready for baking once your pie is assembled.</li><li>Remember to follow any additional preparation or baking instructions provided in the full recipe for your apple crumb pie.</li></ul> |
84
+
| :::image type="content" source="../media/concepts/gpt-v/grandmas-recipe.jpg" lightbox="../media/concepts/gpt-v/grandmas-recipe.jpg" alt-text="Photograph of a recipe card detailing a recipe for Grandma's Apple Crumb Pie."::: You are an AI assistant that helps create shopping lists and instructions to prep food based on recipes. Please provide a list of ingredients to purchase, and then provide a list of instructions to prep the ingredients based on the recipe card. | `Sure, here's a shopping list based on the recipe card: `<br>`Shopping List:`</br><ol><li>`5-7 apples (suitable for baking, such as Granny Smith or Honeycrisp)`</li> <li>`1 ready-made pie crust (9-inch) `</li><li>`Sugar (ensure you have enough for 1/2 cup)`</li><li>`All-purpose flour (ensure you have enough for 3/4 cup)`</li><li>`Ground cinnamon`</li><li>`Salt`</li><li>`Butter (ensure you have enough for 3 tablespoons)`</li></ol><br>`Prepping Instructions:`</br> <ul><li>`Peel the apples: Using a vegetable peeler or a paring knife, remove the skin from 5 to 7 apples.`</li><li>`Core and slice the apples: Cut the apples into quarters, remove the cores, and then slice the apple quarters into thin slices or chunks, depending on your preference for pie texture.`</li><li>`Measure the ingredients: Measure out 3/4 cups of sugar, 1/2 teaspoon of cinnamon, a dash of salt (about 1/8 teaspoon), and 3 tablespoons of butter.`</li><li>`Prepare the butter: Cut the butter into small pieces to be ready to use in the recipe. It's often easier to incorporate if it's cold, so keep it refrigerated until it's needed`</li><li>`Preheat your oven according to the pie recipe's instructions so it's ready for baking once your pie is assembled.`</li><li>`Remember to follow any additional preparation or baking instructions provided in the full recipe for your apple crumb pie.`</li></ul> |
0 commit comments