You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/cognitive-services/Speech-Service/windows-voice-assistants-automatic-enablement-guidelines.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,13 +12,13 @@ ms.date: 04/15/2020
12
12
ms.author: travisw
13
13
---
14
14
15
-
# Privacy guidelines for Windows Voice Assistants
15
+
# Privacy guidelines for voice assistants on Windows
16
16
17
17
## About voice activation privacy
18
18
19
19
It's important that users are given clear information about how their voice data is collected and used and important that they are given control over if and how this collection happens. These core facets of privacy -- *disclosure* and *consent* -- are especially important for voice assistants integrated into Windows given the always-listening nature of their use.
20
20
21
-
Developers creating Windows Voice Assistants must include clear user interface elements within their applications that reflect the listening capabilities of the assistant.
21
+
Developers creating voice assistants on Windows must include clear user interface elements within their applications that reflect the listening capabilities of the assistant.
22
22
23
23
> [!NOTE]
24
24
> Failure to provide appropriate disclosure and consent for an assistant application, including after application updates, may result in the assistant becoming unavailable for voice activation until privacy issues are resolved.
@@ -59,4 +59,4 @@ Once these requirements are satisfied, an eligible assistant application will ap
59
59
## Next steps
60
60
61
61
> [!div class="nextstepaction"]
62
-
> [Learn about best practices for Windows Voice Assistants](windows-voice-assistants-best-practices.md)
62
+
> [Learn about best practices for voice assistants on Windows](windows-voice-assistants-best-practices.md)
Copy file name to clipboardExpand all lines: articles/cognitive-services/Speech-Service/windows-voice-assistants-implementation-guide.md
+2-3Lines changed: 2 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -42,14 +42,13 @@ The application needs to register itself, its keyword model, and its language wi
42
42
Start by retrieving the keyword detector. In this sample code, we retrieve the first detector, but you can select a particular detector by selecting it from `configurableDetectors`.
Copy file name to clipboardExpand all lines: articles/cognitive-services/Speech-Service/windows-voice-assistants-overview.md
+3-5Lines changed: 3 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
title:
3
3
Voice Assistants on Windows - Overview
4
4
titleSuffix: Azure Cognitive Services
5
-
description: An overview of the Windows voice assistant platform, including capabilities and development resources available.
5
+
description: An overview of the voice assistants on Windows, including capabilities and development resources available.
6
6
services: cognitive-services
7
7
author: cfogg6
8
8
manager: trrwilson
@@ -13,9 +13,7 @@ ms.date: 04/15/2020
13
13
ms.author: travisw
14
14
---
15
15
16
-
# Overview
17
-
18
-
## Voice Assistants on Windows
16
+
# Voice Assistants on Windows
19
17
20
18
On Windows 10 version 2004 and up, voice assistant applications can take advantage of the Windows ConversationalAgent APIs to achieve a complete voice-enabled assistant experience.
21
19
@@ -29,5 +27,5 @@ On Windows 10 version 2004 and up, voice assistant applications can take advanta
29
27
## Getting Started
30
28
31
29
-**Review the design guidelines:** Our [design guidelines](windows-voice-assistants-best-practices.md) lay out the key work required to provide the best possible experiences for voice activation on Windows 10.
32
-
-**Visit the Getting Started Guide:** Start [here](windows-voice-assistants-get-started.md) for the steps to begin implementing voice assistants on Windows, from setting your development environment through an introduction to the UWP Voice Assistant Sample.
30
+
-**Visit the Getting Started Guide:** Start [here](how-to-windows-voice-assistants-get-started.md) for the steps to begin implementing voice assistants on Windows, from setting your development environment through an introduction to the UWP Voice Assistant Sample.
33
31
-**Try out the sample app**: To experience these capabilities firsthand, visit the [UWP Voice Assistant Sample](windows-voice-assistants-sample-info.md) page and follow the steps to get the sample client running.
Copy file name to clipboardExpand all lines: articles/cognitive-services/Speech-Service/windows-voice-assistants-sample-info.md
+5-10Lines changed: 5 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,19 +15,14 @@ ms.author: travisw
15
15
16
16
# The UWP Voice Assistant sample
17
17
18
-
## Overview
18
+
The UWP Voice Assistant sample is a voice assistant on Windows that serves to
19
19
20
-
The UWP Voice Assistant sample is a Windows Conversational Agent application that serves to
21
-
- demonstrate the use of the Windows Conversational Agent SDK
20
+
- demonstrate the use of the Windows ConversationalAgent APIs
22
21
- display best practices for a voice agent on Windows
23
22
- provide an adaptable app and reusable components for your MVP agent application
24
-
- show how to use Direct Line Speechtogether with the Windows Conversational Agent system for an end-to-end voice agent experience
23
+
- show how Direct Line Speech, along with Bot Framework or Custom Commands, can be used together with the Windows ConversationalAgent APIs for an end-to-end voice agent experience
25
24
26
25
The documentation provided with the sample app walks through the code path of voice activation and agent management, from the prerequisites of startup through proper cleanup.
Copy file name to clipboardExpand all lines: articles/cognitive-services/Speech-Service/windows-voice-assistants-voice-activation.md
+8-14Lines changed: 8 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,48 +13,42 @@ ms.date: 04/15/2020
13
13
ms.author: travisw
14
14
---
15
15
16
-
# Voice Activation
17
-
18
-
## Walk through of voice activation
16
+
# Walk through of voice activation
19
17
20
18
Windows supports voice activation for UWP applications. The following summarizes the steps of the voice activation process, including the steps an application must take to register as activatable by voice.
21
19
22
-
###Agent Activation Runtime
20
+
## Agent Activation Runtime
23
21
24
22
The Agent Activation Runtime (AAR) is the ongoing process in Windows that manages application activation on a spoken keyword or button press. It starts with Windows as long as there is at least one application on the system that is registered with the system. Applications interact with AAR through the ConversationalAgent APIs in the Windows SDK.
25
23
26
-
###Registration
24
+
## Registration
27
25
28
26
The first time a voice activated application is run, it registers its app id and keyword information in a global signal configuration mapping through the ConversationalAgent APIs. Keyword information includes the location of the keyword model file, the language the keyword is in, and an ID to assign to the keyword. AAR registers all configurations in the global mapping with the hardware or software keyword spotter on the system, allowing them to detect the application's keyword.
29
27
30
28
The application also [registers with the Background Service](https://docs.microsoft.com/windows/uwp/launch-resume/register-a-background-task), another process within Windows.
31
29
32
30
Note that this means an application cannot be activated by voice until it has been run once and registration has been allowed to complete.
33
31
34
-
###Activation
32
+
## Activation
35
33
36
34
When the user speaks a keyword, the software or hardware keyword spotter on the system notifies AAR that a keyword has been detected, providing a keyword ID. AAR in turn uses the keyword ID to look up the ActivationSignalDetectorConfiguration application ID in its mapping. To activate the app, AAR sends a request to BackgroundService to start the application with the corresponding application ID.
37
35
38
-
###Receiving an activation
36
+
## Receiving an activation
39
37
40
38
Upon receiving the request from AAR, the Background Service launches the application. The application receives a signal through the OnBackgroundActivated life cycle method in App.xaml.cs with a unique event argument. This tells the application that it was activated by AAR and should act accordingly.
41
39
42
-
###Keyword verification
40
+
## Keyword verification
43
41
44
42
The keyword spotter that triggered the application to start has achieved low power consumption by simplifying the keyword model. This allows the keyword spotter to be "always on" without a high power impact, but it also means the keyword spotter will likely have a high number of "false accepts" where it detects a keyword even though no keyword was spoken. This is why the voice activation system launches the application in the background: to give the application a chance to verify that the keyword was spoken before interrupting the user's current session. AAR saves the audio since a few seconds before the keyword was spotted and makes it accessible to the application. The application can use this to run a more reliable keyword spotter on the same audio.
45
43
46
-
###Foreground Activation
44
+
## Foreground Activation
47
45
48
46
If the application successfully verifies the keyword, it can make a request to be shown in the foreground and display UI.
49
47
50
-
###Voice activation while app is active
48
+
## Voice activation while app is active
51
49
52
50
AAR still signals active applications when their keyword is spoken. Rather than signalling through the life cycle method in App.xaml.cs, though, it signals through an event in the ConversationalAgent APIs.
53
51
54
-
## Voice Activation Example
55
-
56
-
For a walk through of example code that completes registration and handles voice activation and keyword verification, visit the [UWP Voice Assistant Sample App](windows-voice-assistants-sample-info.md).
0 commit comments