Skip to content

Commit ad96724

Browse files
authored
Merge pull request #272149 from sally-baolian/patch-228
Custom tts avatar endpoint update
2 parents 74b08ca + 5f3112d commit ad96724

File tree

2 files changed

+62
-0
lines changed

2 files changed

+62
-0
lines changed
Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,59 @@
1+
---
2+
title: Deploy your custom text to speech avatar model as an endpoint - Speech service
3+
titleSuffix: Azure AI services
4+
description: Learn about how to deploy your custom text to speech avatar model as an endpoint.
5+
author: sally-baolian
6+
manager: nitinme
7+
ms.service: azure-ai-speech
8+
ms.topic: how-to
9+
ms.date: 4/15/2024
10+
ms.author: v-baolianzou
11+
---
12+
13+
# Deploy your custom text to speech avatar model as an endpoint
14+
15+
You must deploy the custom avatar to an endpoint before you can use it. Once your custom text to speech avatar model is successfully trained through our manual process, we will notify you. Then you can deploy it to a custom avatar endpoint. You can create up to 10 custom avatar endpoints for each standard (S0) Speech resource.
16+
17+
After you deploy your custom avatar, it's available to use in Speech Studio or through API:
18+
19+
- The avatar appears in the avatar list of text to speech avatar on [Speech Studio](https://speech.microsoft.com/portal/talkingavatar).
20+
- The avatar appears in the avatar list of live chat avatar on [Speech Studio](https://speech.microsoft.com/portal/livechat).
21+
- You can call the avatar from the API by specifying the avatar model name.
22+
23+
## Add a deployment endpoint
24+
25+
To create a custom avatar endpoint, follow these steps:
26+
27+
1. Sign in to [Speech Studio](https://speech.microsoft.com/portal).
28+
1. Navigate to **Custom Avatar** > Your project name > **Train model**.
29+
1. All available models are listed on the **Train model** page. Select a model link to view more information, such as the created date and a preview image of the custom avatar.
30+
1. Select a model that you would like to deploy, then select the **Deploy model** button above the list.
31+
1. Confirm the deployment to create your endpoint.
32+
33+
Once your model is successfully deployed as an endpoint, you can select the endpoint link on the **Deploy model** page. There, you'll find a link to the text to speech avatar portal on Speech Studio, where you can try and create videos with your custom avatar using text input.
34+
35+
## Remove a deployment endpoint
36+
37+
To remove a deployment endpoint, follow these steps:
38+
39+
1. Sign in to [Speech Studio](https://speech.microsoft.com/portal).
40+
1. Navigate to **Custom Avatar** > Your project name > **Train model**.
41+
1. All available models are listed on the **Train model** page. Select a model link to view more information, such as the created date and a preview image of the custom avatar.
42+
1. Select a model on the **Train model** page. If it's in "Succeeded" status, it means it's in hosting status. You can select the **Delete** button and confirm the deletion to remove the hosting.
43+
44+
## Use your custom neural voice
45+
46+
If you're also creating a custom neural voice for the actor, the avatar can be highly realistic. For more information, see [What is custom text to speech avatar](./what-is-custom-text-to-speech-avatar.md).
47+
48+
[Custom neural voice](../custom-neural-voice.md) and [custom text to speech avatar](what-is-custom-text-to-speech-avatar.md) are separate features. You can use them independently or together.
49+
50+
If you've built a custom neural voice (CNV) and would like to use it together with the custom avatar, pay attention to the following points:
51+
52+
- Ensure that the CNV endpoint is created in the same Speech resource as the custom avatar endpoint. You can see the CNV voice option in the voices list of the [avatar content generation page](https://speech.microsoft.com/portal/talkingavatar) and [live chat voice settings](https://speech.microsoft.com/portal/livechat).
53+
- If you're using the batch synthesis for avatar API, add the "customVoices" property to associate the deployment ID of the CNV model with the voice name in the request. For more information, refer to the [Text to speech properties](batch-synthesis-avatar-properties.md#text-to-speech-properties).
54+
- If you're using real-time synthesis for avatar API, refer to our sample code on [GitHub](https://github.com/Azure-Samples/cognitive-services-speech-sdk/tree/master/samples/js/browser/avatar) to set the custom neural voice.
55+
- If your custom neural voice endpoint is in a different Speech resource from the custom avatar endpoint, refer to [Train your professional voice model](../professional-voice-train-voice.md#copy-your-voice-model-to-another-project) to copy the CNV model to the same Speech resource as the custom avatar endpoint.
56+
57+
## Next steps
58+
59+
- Learn more about custom text to speech avatar in the [overview](what-is-custom-text-to-speech-avatar.md).

articles/ai-services/speech-service/toc.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -224,6 +224,9 @@ items:
224224
- name: How to record video samples
225225
href: text-to-speech-avatar/custom-avatar-record-video-samples.md
226226
displayName: avatar
227+
- name: Deploy your custom text to speech avatar model as an endpoint
228+
href: text-to-speech-avatar/custom-avatar-endpoint.md
229+
displayName: avatar
227230
- name: Audio Content Creation
228231
href: how-to-audio-content-creation.md
229232
displayName: acc

0 commit comments

Comments
 (0)