update

Author: xiaojul

articles/cognitive-services/Speech-Service/how-to-custom-speech-commands-fulfill-sdk.md

@@ -13,7 +13,7 @@ ms.date: 03/12/2020
 ms.author: donkim
 ---
 
-# Fulfill commands from a client with the Speech SDK (Preview)
+# Fulfill commands from a client with the Speech SDK
 
 To complete tasks using a Custom Commands application you can send custom payloads to a connected client device.
 
@@ -28,17 +28,17 @@ In this article, you'll:
 - An Azure subscription key for Speech service
   - [Get one for free](get-started.md) or create it on the [Azure portal](https://portal.azure.com)
 - A previously created Custom Commands app
-  - [Quickstart: Create a Custom Command with Parameters (Preview)](./quickstart-custom-speech-commands-create-parameters.md)
+  - [Quickstart: Create a Custom Command with Parameters](./quickstart-custom-speech-commands-create-parameters.md)
 - A Speech SDK enabled client application
-  - [Quickstart: Connect to a Custom Command application with the Speech SDK (Preview)](./quickstart-custom-speech-commands-speech-sdk.md)
+  - [Quickstart: Connect to a Custom Command application with the Speech SDK](./quickstart-custom-speech-commands-speech-sdk.md)
 
 ## Optional: Get started fast
 
 This article describes, step by step, how to make a client application to talk to your Custom Commands application. If you prefer to dive right in, the complete, ready-to-compile source code used in this article is available in the [Speech SDK Samples](https://aka.ms/csspeech/samples).
 
 ## Fulfill with JSON payload
 
-1. Open your previously created Custom Commands application from the [Speech Studio](https://speech.microsoft.com/)
+1. Open the Custom Commands application you previously created from [Quickstarts: Create a custom command with parameters](./quickstart-custom-speech-commands-create-parameters.md)
 1. Check the **Completion Rules** section to make sure you have the previously created rule that responds back to the user
 1. To send a payload directly to the client, create a new rule with a Send Activity action
 
@@ -51,9 +51,7 @@ This article describes, step by step, how to make a client application to talk t
    | Conditions | Required Parameter - `OnOff` and `SubjectDevice` | Conditions that determine when the rule can run |
    | Actions | `SendActivity` (see below) | The action to take when the rule condition is true |
 
-   > [!div class="mx-imgBorder"]
-   > ![Send Activity payload](media/custom-speech-commands/fulfill-sdk-send-activity-action.png)
-
+1. Copy the JSON below to **Activity content**
    ```json
    {
      "type": "event",
@@ -62,12 +60,14 @@ This article describes, step by step, how to make a client application to talk t
      "device": "{SubjectDevice}"
    }
    ```
+   > [!div class="mx-imgBorder"]
+   > ![Send Activity payload](media/custom-speech-commands/fulfill-sdk-send-activity-action.png)
 
 ## Create visuals for device on or off state
 
-In [Quickstart: Connect to a Custom Command application with the Speech SDK (Preview)](./quickstart-custom-speech-commands-speech-sdk.md) you created a Speech SDK client application that handled commands such as `turn on the tv`, `turn off the fan`. Now add some visuals so you can see the result of those commands.
+In [Quickstart: Connect to a Custom Command application with the Speech SDK](./quickstart-custom-speech-commands-speech-sdk.md), you created a Speech SDK client application that handled commands such as `turn on the tv`, `turn off the fan`. With some visuals added, you can see the result of those commands.
 
-Add labeled boxes with text indicating **On** or **Off** using the following XML added to `MainPage.xaml.cs`
+Add labeled boxes with text indicating **On** or **Off** using the following XML added to `MainPage.xaml`
 
 ```xml
 <StackPanel Orientation="Horizontal" HorizontalAlignment="Center" Margin="20">
@@ -87,36 +87,57 @@ Add labeled boxes with text indicating **On** or **Off** using the following XML
 ```
 
 ## Handle customizable payload
+### Add reference libraries
 
-Now that you've created a JSON payload, you can add a reference to the [JSON.NET](https://www.newtonsoft.com/json) library to handle deserialization.
+Since you've created a JSON payload, you need to add a reference to the [JSON.NET](https://www.newtonsoft.com/json) library to handle deserialization.
+- Right-client your solution.
+- Choose **Manage NuGet Packages for Solution**, Select **Install** 
+- Search for **Newtonsoft.json** in the update list, Update **Microsoft.NETCore.UniversalWindowsPlatform** to newest version
 
 > [!div class="mx-imgBorder"]
 > ![Send Activity payload](media/custom-speech-commands/fulfill-sdk-json-nuget.png)
 
-In `InitializeDialogServiceConnector` add the following to your `ActivityReceived` event handler. The additional code will extract the payload from the activity and change the visual state of the tv or fan accordingly.
+In `MainPage.xaml.cs', add
+- `using Newtonsoft.Json;` 
+- `using Windows.ApplicationModel.Core;`
+
+### Handle received payload
+
+In `InitializeDialogServiceConnector`, replace the `ActivityReceived` event handler with following code. The modified `ActivityReceived` event handler will extract the payload from the activity and change the visual state of the tv or fan accordingly.
 
 ```C#
 connector.ActivityReceived += async (sender, activityReceivedEventArgs) =>
 {
     NotifyUser($"Activity received, hasAudio={activityReceivedEventArgs.HasAudio} activity={activityReceivedEventArgs.Activity}");
 
     dynamic activity = JsonConvert.DeserializeObject(activityReceivedEventArgs.Activity);
+    var name = activity?.name != null ? activity.name.ToString() : string.Empty;
 
-    if(activity?.name == "SetDeviceState")
+    if (name.Equals("UpdateDeviceState"))
     {
-        var state = activity?.state;
-        var device = activity?.device;
-        switch(device)
+        Debug.WriteLine("Here");
+        var state = activity?.device != null ? activity.state.ToString() : string.Empty;
+        var device = activity?.device != null ? activity.device.ToString() : string.Empty;
+
+        if (state.Equals("on") || state.Equals("off"))
         {
-            case "tv":
-                State_TV.Text = state;
-                break;
-            case "fan":
-                State_Fan.Text = state;
-                break;
-            default:
-                NotifyUser($"Received request to set unsupported device {device} to {state}");
-                break;
+            switch (device)
+            {
+                case "tv":
+                    await CoreApplication.MainView.CoreWindow.Dispatcher.RunAsync(
+                        CoreDispatcherPriority.Normal, () => { State_TV.Text = state; });
+                    break;
+                case "fan":
+                    await CoreApplication.MainView.CoreWindow.Dispatcher.RunAsync(
+                        CoreDispatcherPriority.Normal, () => { State_Fan.Text = state; });
+                    break;
+                default:
+                    NotifyUser($"Received request to set unsupported device {device} to {state}");
+                    break;
+            }
+        }
+        else { 
+            NotifyUser($"Received request to set unsupported state {state}");
         }
     }
 
@@ -134,6 +155,8 @@ connector.ActivityReceived += async (sender, activityReceivedEventArgs) =>
 1. Select the Talk button
 1. Say `turn on the tv`
 1. The visual state of the tv should change to "On"
+   > [!div class="mx-imgBorder"]
+   > ![Send Activity payload](media/custom-speech-commands/fulfill-sdk-uwp-turnontv.png)
 
 ## Next steps