Skip to content

Commit 7b4912d

Browse files
authored
Merge pull request #4307 from MicrosoftDocs/release-preview-ig
Release preview ig -> main -- 04/24 - 16:00
2 parents 5831a7c + 05da916 commit 7b4912d

25 files changed

+426
-82
lines changed

articles/ai-services/openai/concepts/content-credentials.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: PatrickFarley
66
ms.author: pafarley
77
ms.service: azure-ai-openai
88
ms.topic: conceptual
9-
ms.date: 02/20/2025
9+
ms.date: 04/23/2025
1010
manager: nitinme
1111
---
1212

@@ -16,14 +16,14 @@ With the improved quality of content from generative AI models, there is an incr
1616

1717
## What are Content Credentials?
1818

19-
Content Credentials in the Azure OpenAI Service provide customers with information about the origin of an image generated by the DALL-E series models. This information is represented by a manifest attached to the image. The manifest is cryptographically signed by a certificate that traces back to Azure OpenAI Service.
19+
Content Credentials in the Azure OpenAI Service provide customers with information about the origin of an image generated by the image generation models. This information is represented by a manifest attached to the image. The manifest is cryptographically signed by a certificate that traces back to Azure OpenAI Service.
2020

2121
The manifest contains several key pieces of information:
2222

2323
| Field name | Field content |
2424
| ---| ---|
25-
| `"description"` | This field has a value of `"AI Generated Image"` for all DALL-E model generated images, attesting to the AI-generated nature of the image. |
26-
| `"softwareAgent"` | This field has a value of `"Azure OpenAI DALL-E"` for all images generated by DALL-E series models in Azure OpenAI Service. |
25+
| `"description"` | This field has a value of `"AI Generated Image"` for all generated images, attesting to the AI-generated nature of the image. |
26+
| `"softwareAgent"` | This field has a value of `"Azure OpenAI DALL-E"` or `"Azure OpenAI ImageGen"` for all images generated by DALL-E series models or GPT-image-1 models in Azure OpenAI Service. |
2727
|`"when"` |The timestamp of when the Content Credentials were created. |
2828

2929

@@ -32,12 +32,12 @@ Content Credentials in the Azure OpenAI Service can help people understand when
3232
## How do I use Content Credentials in my solution today?
3333

3434
Customers may use Content Credentials by:
35-
- Ensuring that their AI generated images contain Content Credentials
36-
No additional set-up is necessary. Content Credentials are automatically applied to all generated images from DALL·E in the Azure OpenAI Service.
35+
- Ensuring that their AI-generated images contain Content Credentials
36+
No additional set-up is necessary. Content Credentials are automatically applied to all generated images from DALL·E and GPT-image-1 in the Azure OpenAI Service.
3737
- Verifying that an image has Content Credentials
38-
There are two recommended ways today to check the credential of an image generated by Azure OpenAI DALL-E models:
38+
There are two recommended ways today to check the credential of an image generated by Azure OpenAI models:
3939

40-
- **Content Credentials Verify webpage (contentcredentials.org/verify)**: This is a tool that allows users to inspect the Content Credentials of a piece of content. If an image was generated by DALL-E in Azure OpenAI, the tool will display that its Content Credentials were issued by Microsoft Corporation alongside the date and time of issuance.
40+
- **Content Credentials Verify webpage (contentcredentials.org/verify)**: This is a tool that allows users to inspect the Content Credentials of a piece of content. If an image was generated by an Azure OpenAI image generation model, the tool will display that its Content Credentials were issued by Microsoft Corporation alongside the date and time of issuance.
4141
:::image type="content" source="../media/encryption/credential-check.png" alt-text="Screenshot of the content credential verification website.":::
4242

4343
This page shows that an image generated by Azure OpenAI DALL-E has Content Credentials issued by Microsoft.

articles/ai-services/openai/concepts/content-filter.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ manager: nitinme
1616
> [!IMPORTANT]
1717
> The content filtering system isn't applied to prompts and completions processed by the audio models such as Whisper in Azure OpenAI Service. Learn more about the [Audio models in Azure OpenAI](models.md?tabs=standard-audio#standard-deployment-regional-models-by-endpoint).
1818
19-
Azure OpenAI Service includes a content filtering system that works alongside core models, including DALL-E image generation models. This system works by running both the prompt and completion through an ensemble of classification models designed to detect and prevent the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Variations in API configurations and application design might affect completions and thus filtering behavior.
19+
Azure OpenAI Service includes a content filtering system that works alongside core models, including image generation models. This system works by running both the prompt and completion through an ensemble of classification models designed to detect and prevent the output of harmful content. The content filtering system detects and takes action on specific categories of potentially harmful content in both input prompts and output completions. Variations in API configurations and application design might affect completions and thus filtering behavior.
2020

2121
The text content filtering models for the hate, sexual, violence, and self-harm categories have been specifically trained and tested on the following languages: English, German, Japanese, Spanish, French, Italian, Portuguese, and Chinese. However, the service can work in many other languages, but the quality might vary. In all cases, you should do your own testing to ensure that it works for your application.
2222

articles/ai-services/openai/concepts/default-safety-policies.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -65,4 +65,4 @@ Text models in the Azure OpenAI Service can take in and generate both text and c
6565
| Profanity | Prompts | N/A |
6666

6767

68-
In addition to the above safety configurations, Azure OpenAI DALL-E also comes with [prompt transformation](./prompt-transformation.md) by default. This transformation occurs on all prompts to enhance the safety of your original prompt, specifically in the risk categories of diversity, deceptive generation of political candidates, depictions of public figures, protected material, and others.
68+
In addition to the above safety configurations, the latest image generation models also come with [prompt transformation](./prompt-transformation.md) by default. This transformation occurs on all prompts to enhance the safety of your original prompt, specifically in the risk categories of diversity, deceptive generation of political candidates, depictions of public figures, protected material, and others.

articles/ai-services/openai/concepts/models.md

Lines changed: 22 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ titleSuffix: Azure OpenAI
44
description: Learn about the different model capabilities that are available with Azure OpenAI.
55
ms.service: azure-ai-openai
66
ms.topic: conceptual
7-
ms.date: 04/16/2025
7+
ms.date: 04/23/2025
88
ms.custom: references_regions, build-2023, build-2023-dataai, refefences_regions
99
manager: nitinme
1010
author: mrbullwinkle #ChrisHMSFT
@@ -25,8 +25,8 @@ Azure OpenAI Service is powered by a diverse set of models with different capabi
2525
| [GPT-4o & GPT-4o mini & GPT-4 Turbo](#gpt-4o-and-gpt-4-turbo) | The latest most capable Azure OpenAI models with multimodal versions, which can accept both text and images as input. |
2626
| [GPT-4](#gpt-4) | A set of models that improve on GPT-3.5 and can understand and generate natural language and code. |
2727
| [GPT-3.5](#gpt-35) | A set of models that improve on GPT-3 and can understand and generate natural language and code. |
28-
| [Embeddings](#embeddings) | A set of models that can convert text into numerical vector form to facilitate text similarity. |
29-
| [DALL-E](#dall-e-models) | A series of models that can generate original images from natural language. |
28+
| [Embeddings](#embeddings-models) | A set of models that can convert text into numerical vector form to facilitate text similarity. |
29+
| [Image generation](#image-generation-models) | A series of models that can generate original images from natural language. |
3030
| [Audio](#audio-models) | A series of models for speech to text, translation, and text to speech. GPT-4o audio models support either low-latency, "speech in, speech out" conversational interactions or audio generation. |
3131

3232
## GPT 4.1 series
@@ -220,9 +220,24 @@ The third generation embeddings models support reducing the size of the embeddin
220220

221221
OpenAI's MTEB benchmark testing found that even when the third generation model's dimensions are reduced to less than `text-embeddings-ada-002` 1,536 dimensions performance remains slightly better.
222222

223-
## DALL-E
223+
## Image generation models
224224

225-
The DALL-E models generate images from text prompts that the user provides. DALL-E 3 is generally available for use with the REST APIs. DALL-E 2 and DALL-E 3 with client SDKs are in preview.
225+
The image generation models generate images from text prompts that the user provides. GPT-image-1 is in limited access public preview. DALL-E 3 is generally available for use with the REST APIs. DALL-E 2 and DALL-E 3 with client SDKs are in preview.
226+
227+
### Availability
228+
229+
**For access to `gpt-image-1` registration is required, and access will be granted based on Microsoft's eligibility criteria**. Customers who have access to other limited access models will still need to request access for this model.
230+
231+
Request access: [`computer-use-preview` limited access model application](https://aka.ms/oai/gptimage1access)
232+
233+
Once access has been granted, you will need to create a deployment for the model.
234+
235+
### Region availability
236+
237+
| Model | Region |
238+
|---|---|
239+
|`dall-e-3` | East US<br>Australia East<br>Sweden Central|
240+
|`gpt-image-1` | West US 2 (Global Standard) <br> UAE North (Global Standard) |
226241

227242
## Audio models
228243

@@ -414,10 +429,11 @@ These models can only be used with Embedding API requests.
414429

415430
[!INCLUDE [Image Generation](../includes/model-matrix/standard-image-generation.md)]
416431

417-
### DALL-E models
432+
### Image generation models
418433

419434
| Model ID | Max Request (characters) |
420435
| --- | :---: |
436+
| gpt-image-1 | 4,000 |
421437
| dall-e-3 | 4,000 |
422438

423439
# [Audio](#tab/standard-audio)

articles/ai-services/openai/concepts/prompt-transformation.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -12,12 +12,12 @@ manager: nitinme
1212

1313
# What is prompt transformation?
1414

15-
Prompt transformation is a process included in DALL-E 3 image generation that applies a safety and quality system message to your original prompt. It uses a large language model (LLM) call to add the message before sending your prompt to the model for image generation. This system message enriches your original prompt with the goal of generating more diverse and higher-quality images while maintaining intent.
15+
Prompt transformation is a process included in the DALL-E 3 and GPT-image-1 (preview) models that applies a safety and quality system message to your original prompt. It uses a large language model (LLM) call to add the message before sending your prompt to the model for image generation. This system message enriches your original prompt with the goal of generating more diverse and higher-quality images while maintaining intent.
1616

1717
After prompt transformation is applied to the original prompt, content filtering is applied as a secondary step before image generation; for more information, see [Content filtering](./content-filter.md).
1818

1919
> [!TIP]
20-
> Learn more about image generation prompting in OpenAI's [DALL·E documentation](https://platform.openai.com/docs/guides/images/language-specific-tips).
20+
> Learn more about image generation prompting in OpenAI's [Image generation documentation](https://platform.openai.com/docs/guides/images/language-specific-tips).
2121
2222
## Prompt transformation example
2323

@@ -30,11 +30,11 @@ After prompt transformation is applied to the original prompt, content filtering
3030

3131
Prompt transformation is essential for responsible and high-quality generations. Not only does prompt transformation improve the safety of your generated image, but it also enriches your prompt in a more descriptive manner, leading to higher quality and descriptive imagery.
3232

33-
Default prompt transformation in Azure OpenAI DALL-E 3 contains safety enhancements that steer the model away from generating images of Copyright Studio characters and artwork, public figures, and other harmful content such as sexual, hate and unfairness, violence, and self-harm content.
33+
Default prompt transformation contains safety enhancements that steer the model away from generating images of Copyright Studio characters and artwork, public figures, and other harmful content such as sexual, hate and unfairness, violence, and self-harm content.
3434

3535
## How do I use prompt transformation?
3636

37-
Prompt transformation is applied by default to all Azure OpenAI DALL-E 3 requests. No extra setup is required to benefit from prompt transformation enhancements.
37+
Prompt transformation is applied by default to all Azure OpenAI DALL-E 3 and GPT-image-1 requests. No extra setup is required to benefit from prompt transformation enhancements.
3838

3939
Like image generation, prompt transformation is non-deterministic due to the nature of large language models. A single original prompt may lead to many image variants.
4040

@@ -69,4 +69,4 @@ Output Content:
6969
## Next step
7070

7171
> [!div class="nextstepaction"]
72-
> [DALL-E quickstart](/azure/ai-services/openai/dall-e-quickstart)
72+
> [Image generation quickstart](/azure/ai-services/openai/dall-e-quickstart)

articles/ai-services/openai/faq.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ sections:
4141
- question: |
4242
How do the capabilities of Azure OpenAI compare to OpenAI?
4343
answer: |
44-
Azure OpenAI Service gives customers advanced language AI with OpenAI GPT-3, Codex, and DALL-E models with the security and enterprise promise of Azure. Azure OpenAI codevelops the APIs with OpenAI, ensuring compatibility and a smooth transition from one to the other.
44+
Azure OpenAI Service gives customers advanced language AI with the latest OpenAI models with the security and enterprise promise of Azure. Azure OpenAI codevelops the APIs with OpenAI, ensuring compatibility and a smooth transition from one to the other.
4545
4646
With Azure OpenAI, customers get the security capabilities of Microsoft Azure while running the same models as OpenAI.
4747
- question: |

articles/ai-services/openai/how-to/content-filters.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ ms.custom: FY25Q1-Linter
1515

1616
# How to configure content filters
1717

18-
The content filtering system integrated into Azure AI Foundry runs alongside the core models, including DALL-E image generation models. It uses an ensemble of multi-class classification models to detect four categories of harmful content (violence, hate, sexual, and self-harm) at four severity levels respectively (safe, low, medium, and high), and optional binary classifiers for detecting jailbreak risk, existing text, and code in public repositories.
18+
The content filtering system integrated into Azure AI Foundry runs alongside the core models, including image generation models. It uses an ensemble of multi-class classification models to detect four categories of harmful content (violence, hate, sexual, and self-harm) at four severity levels respectively (safe, low, medium, and high), and optional binary classifiers for detecting jailbreak risk, existing text, and code in public repositories.
1919

2020
The default content filtering configuration is set to filter at the medium severity threshold for all four content harms categories for both prompts and completions. That means that content that is detected at severity level medium or high is filtered, while content detected at severity level low or safe is not filtered by the content filters. Learn more about content categories, severity levels, and the behavior of the content filtering system [here](../concepts/content-filter.md).
2121

0 commit comments

Comments
 (0)