Merge pull request #196093 from eric-urban/eur/compressed-audio

compressed-audio

Author: PMEds28

articles/cognitive-services/Speech-Service/captioning-concepts.md

@@ -38,7 +38,7 @@ Captioning can accompany real time or pre-recorded speech. Whether you're showin
 
 For real time captioning, use a microphone or audio input stream instead of file input. For examples of how to recognize speech from a microphone, see the [Speech to text quickstart](get-started-speech-to-text.md) and [How to recognize speech](how-to-recognize-speech.md) documentation. For more information about streaming, see [How to use the audio input stream](how-to-use-audio-input-streams.md).
 
-For captioning of a prerecoding, send file input to the Speech service. For more information, see [How to use compressed audio files](how-to-use-codec-compressed-audio-input-streams.md).
+For captioning of a prerecoding, send file input to the Speech service. For more information, see [How to use compressed input audio](how-to-use-codec-compressed-audio-input-streams.md).
 
 ## Caption and speech synchronization 
 

articles/cognitive-services/Speech-Service/how-to-use-codec-compressed-audio-input-streams.md

@@ -1,125 +1,63 @@
 ---
-title: How to use compressed audio files with the Speech SDK - Speech service
+title: How to use compressed input audio - Speech service
 titleSuffix: Azure Cognitive Services
-description: Learn how to use compressed audio files to the Speech service with the Speech SDK. 
+description: Learn how to use compressed input audio the Speech SDK and CLI. 
 services: cognitive-services
 author: eric-urban
 ms.author: eur
 manager: nitinme
 ms.service: cognitive-services
 ms.subservice: speech-service
 ms.topic: how-to
-ms.date: 01/13/2022
+ms.date: 04/25/2022
 ms.devlang: cpp, csharp, golang, java, python
 ms.custom: devx-track-csharp
-zone_pivot_groups: programming-languages-set-twenty-eight
+zone_pivot_groups: programming-languages-speech-services
 ---
 
-# How to use compressed audio files
-
-The Speech SDK and Speech CLI use GStreamer to support different kinds of input audio formats. GStreamer decompresses the audio before it's sent over the wire to the Speech service as raw PCM.
-
-[!INCLUDE [supported-audio-formats](includes/supported-audio-formats.md)]
-
-## Install GStreamer
-
-Choose a platform for installation instructions.
-
-Platform | Languages | Supported GStreamer version
-| :--- | ---: | :---:
-Android  | Java | [1.18.3](https://gstreamer.freedesktop.org/data/pkg/android/1.18.3/)
-Linux  | C++, C#, Java, Python, Go | [Supported Linux distributions and target architectures](~/articles/cognitive-services/speech-service/speech-sdk.md)
-Windows (excluding UWP) | C++, C#, Java, Python | [1.18.3](https://gstreamer.freedesktop.org/data/pkg/windows/1.18.3/msvc/gstreamer-1.0-msvc-x86_64-1.18.3.msi)
-
-### [Android](#tab/android)
-
-For more information about building libgstreamer_android.so, see [GStreamer configuration by programming language](#gstreamer-configuration).
-
-For more information, see [Android installation instructions](https://gstreamer.freedesktop.org/documentation/installing/for-android-development.html?gi-language=c).
-
-### [Linux](#tab/linux)
-
-For more information, see [Linux installation instructions](https://gstreamer.freedesktop.org/documentation/installing/on-linux.html?gi-language=c).  
-
-```sh
-sudo apt install libgstreamer1.0-0 \
-gstreamer1.0-plugins-base \
-gstreamer1.0-plugins-good \
-gstreamer1.0-plugins-bad \
-gstreamer1.0-plugins-ugly
-```
-### [Windows](#tab/windows)
-
-Make sure that packages of the same platform (x64 or x86) are installed. For example, if you installed the x64 package for Python, you need to install the x64 GStreamer package. The following instructions are for the x64 packages.
-
-1. Create the folder c:\gstreamer.
-1. Download the [installer](https://gstreamer.freedesktop.org/data/pkg/windows/1.18.3/msvc/gstreamer-1.0-msvc-x86_64-1.18.3.msi).
-1. Copy the installer to c:\gstreamer.
-1. Open PowerShell as an administrator.
-1. Run the following command in PowerShell:
-
-    ```powershell
-    cd c:\gstreamer
-    msiexec /passive INSTALLLEVEL=1000 INSTALLDIR=C:\gstreamer /i gstreamer-1.0-msvc-x86_64-1.18.3.msi
-    ```
-
-1. Add the system variables GST_PLUGIN_PATH with the value C:\gstreamer\1.0\msvc_x86_64\lib\gstreamer-1.0.
-1. Add the system variables GSTREAMER_ROOT_X86_64 with the value C:\gstreamer\1.0\msvc_x86_64.
-1. Add another entry in the path variable as C:\gstreamer\1.0\msvc_x86_64\bin.
-1. Reboot the machine.
-
-For more information about GStreamer, see [Windows installation instructions](https://gstreamer.freedesktop.org/documentation/installing/on-windows.html?gi-language=c).
-
-***
-
-## GStreamer configuration
-
-> [!NOTE]
-> GStreamer configuration requirements vary by programming language. For more information, choose your programming language at the top of this page. The contents of this section will be updated.
+# How to use compressed input audio
 
 ::: zone pivot="programming-language-csharp"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/csharp/prerequisites.md)]
+[!INCLUDE [C# include](includes/how-to/compressed-audio-input/csharp.md)]
 ::: zone-end
 
 ::: zone pivot="programming-language-cpp"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/cpp/prerequisites.md)]
+[!INCLUDE [C++ include](includes/how-to/compressed-audio-input/cpp.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-java"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/java/prerequisites.md)]
+::: zone pivot="programming-language-go"
+[!INCLUDE [Go include](includes/how-to/compressed-audio-input/go.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-python"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/python/prerequisites.md)]
+::: zone pivot="programming-language-java"
+[!INCLUDE [Java include](includes/how-to/compressed-audio-input/java.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-go"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/go/prerequisites.md)]
+::: zone pivot="programming-language-javascript"
+[!INCLUDE [JavaScript include](includes/how-to/compressed-audio-input/javascript.md)]
 ::: zone-end
 
-## Example
-
-::: zone pivot="programming-language-csharp"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/csharp/examples.md)]
+::: zone pivot="programming-language-objectivec"
+[!INCLUDE [ObjectiveC include](includes/how-to/compressed-audio-input/objectivec.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-cpp"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/cpp/examples.md)]
+::: zone pivot="programming-language-swift"
+[!INCLUDE [Swift include](includes/how-to/compressed-audio-input/swift.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-java"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/java/examples.md)]
+::: zone pivot="programming-language-python"
+[!INCLUDE [Python include](./includes/how-to/compressed-audio-input/python.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-python"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/python/examples.md)]
+::: zone pivot="programming-language-rest"
+[!INCLUDE [REST include](includes/how-to/compressed-audio-input/rest.md)]
 ::: zone-end
 
-::: zone pivot="programming-language-go"
-[!INCLUDE [prerequisites](includes/how-to/compressed-audio-input/go/examples.md)]
+::: zone pivot="programming-language-cli"
+[!INCLUDE [CLI include](includes/how-to/compressed-audio-input/cli.md)]
 ::: zone-end
 
 ## Next steps
 
-> [!div class="nextstepaction"]
-> [Learn how to recognize speech](./get-started-speech-to-text.md)
+* [Try the speech to text quickstart](get-started-speech-to-text.md)
+* [Improve recognition accuracy with custom speech](custom-speech-overview.md)

articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/cli.md

@@ -0,0 +1,62 @@
+---
+author: eric-urban
+ms.service: cognitive-services
+ms.topic: include
+ms.date: 09/08/2020
+ms.author: eur
+---
+
+[!INCLUDE [Introduction](intro.md)]
+
+## GStreamer configuration
+
+The Speech CLI can use [GStreamer](https://gstreamer.freedesktop.org) to handle compressed audio. For licensing reasons, GStreamer binaries aren't compiled and linked with the Speech CLI. You need to install some dependencies and plug-ins. 
+
+GStreamer binaries must be in the system path so that they can be loaded by the Speech CLI at runtime. For example, on Windows, if the Speech CLI finds `libgstreamer-1.0-0.dll` or `gstreamer-1.0-0.dll` (for the latest GStreamer) during runtime, it means the GStreamer binaries are in the system path.
+
+Choose a platform for installation instructions.
+
+### [Linux](#tab/linux)
+
+[!INCLUDE [Linux](gstreamer-linux.md)]
+
+### [Windows](#tab/windows)
+
+[!INCLUDE [Windows](gstreamer-windows.md)]
+
+***
+
+## Example
+
+The `--format` option specifies the container format for the audio file being recognized. For an mp4 file, set the format to `any` as shown in the following command:
+
+# [Terminal](#tab/terminal)
+
+```console
+spx recognize --file YourAudioFile.mp4 --format any
+```
+
+# [PowerShell](#tab/powershell)
+
+```powershell
+spx --% recognize --file YourAudioFile.mp4 --format any
+```
+
+***
+
+To get a list of supported audio formats, run the following command:
+
+# [Terminal](#tab/terminal)
+
+```console
+spx help recognize format
+```
+
+# [PowerShell](#tab/powershell)
+
+```powershell
+spx help recognize format
+```
+
+***
+

articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/cpp/examples.md renamed to articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/cpp.md

@@ -2,10 +2,34 @@
 author: eric-urban
 ms.service: cognitive-services
 ms.topic: include
-ms.date: 03/09/2020
+ms.date: 03/06/2020
 ms.author: eur
 ---
 
+[!INCLUDE [Header](../../common/cpp.md)]
+
+[!INCLUDE [Introduction](intro.md)]
+
+## GStreamer configuration
+
+The Speech SDK can use [GStreamer](https://gstreamer.freedesktop.org) to handle compressed audio. For licensing reasons, GStreamer binaries aren't compiled and linked with the Speech SDK. You need to install some dependencies and plug-ins.  
+
+GStreamer binaries must be in the system path so that they can be loaded by the Speech SDK at runtime. For example, on Windows, if the Speech SDK finds `libgstreamer-1.0-0.dll` or `gstreamer-1.0-0.dll` (for the latest GStreamer) during runtime, it means the GStreamer binaries are in the system path.
+
+Choose a platform for installation instructions.
+
+### [Linux](#tab/linux)
+
+[!INCLUDE [Linux](gstreamer-linux.md)]
+
+### [Windows](#tab/windows)
+
+[!INCLUDE [Windows](gstreamer-windows.md)]
+
+***
+
+## Example
+
 To configure the Speech SDK to accept compressed audio input, create `PullAudioInputStream` or `PushAudioInputStream`. Then, create an `AudioConfig` from an instance of your stream class that specifies the compression format of the stream. Find related sample code in [Speech SDK samples](https://github.com/Azure-Samples/cognitive-services-speech-sdk/blob/master/samples/cpp/windows/console/samples/speaker_recognition_samples.cpp).
 
 Let's assume that you have an input stream class called `pushStream` and are using OPUS/OGG. Your code might look like this:

articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/csharp/examples.md renamed to articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/csharp.md

@@ -2,12 +2,36 @@
 author: eric-urban
 ms.service: cognitive-services
 ms.topic: include
-ms.date: 03/09/2020
+ms.date: 03/11/2020
 ms.author: eur
 ms.custom: devx-track-csharp
 ---
 
-To configure the Speech SDK to accept compressed audio input, create `PullAudioInputStream` or `PushAudioInputStream`. Then, create an `AudioConfig` from an instance of your stream class that specifies the compression format of the stream. Find related sample code snippets in [About the Speech SDK audio input stream API](../../../../how-to-use-audio-input-streams.md).
+[!INCLUDE [Header](../../common/csharp.md)]
+
+[!INCLUDE [Introduction](intro.md)]
+
+## GStreamer configuration
+
+The Speech SDK can use [GStreamer](https://gstreamer.freedesktop.org) to handle compressed audio. For licensing reasons, GStreamer binaries aren't compiled and linked with the Speech SDK. You need to install some dependencies and plug-ins.  
+
+GStreamer binaries must be in the system path so that they can be loaded by the Speech SDK at runtime. For example, on Windows, if the Speech SDK finds `libgstreamer-1.0-0.dll` or `gstreamer-1.0-0.dll` (for the latest GStreamer) during runtime, it means the GStreamer binaries are in the system path.
+
+Choose a platform for installation instructions.
+
+### [Linux](#tab/linux)
+
+[!INCLUDE [Linux](gstreamer-linux.md)]
+
+### [Windows](#tab/windows)
+
+[!INCLUDE [Windows](gstreamer-windows.md)]
+
+***
+
+## Example
+
+To configure the Speech SDK to accept compressed audio input, create `PullAudioInputStream` or `PushAudioInputStream`. Then, create an `AudioConfig` from an instance of your stream class that specifies the compression format of the stream. Find related sample code snippets in [About the Speech SDK audio input stream API](../../../how-to-use-audio-input-streams.md).
 
 Let's assume that you have an input stream class called `pullStream` and are using OPUS/OGG. Your code might look like this:
 

articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/csharp/prerequisites.md

@@ -1,11 +1,23 @@
 ---
-author: amitkumarshukla
+author: eric-urban
 ms.service: cognitive-services
 ms.topic: include
-ms.date: 09/17/2021
-ms.author: amishu
+ms.date: 09/15/2020
+ms.author: eur
 ---
 
+[!INCLUDE [Header](../../common/go.md)]
+
+[!INCLUDE [Introduction](intro.md)]
+
+## GStreamer configuration
+
+The Speech SDK can use [GStreamer](https://gstreamer.freedesktop.org) to handle compressed audio. For licensing reasons, GStreamer binaries aren't compiled and linked with the Speech SDK. You need to install some dependencies and plug-ins. 
+
+[!INCLUDE [Linux](gstreamer-linux.md)]
+
+## Example
+
 To configure the Speech SDK to accept compressed audio input, create a `PullAudioInputStream` or `PushAudioInputStream`. Then, create an `AudioConfig` from an instance of your stream class that specifies the compression format of the stream.
 
 In the following example, let's assume that your use case is to use `PushStream` for a compressed file.

articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/go/examples.md renamed to articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/go.md

@@ -1,11 +1,13 @@
 ---
 author: eric-urban
 ms.service: cognitive-services
+ms.subservice: speech-service
 ms.topic: include
-ms.date: 03/09/2020
+ms.date: 04/25/2022
 ms.author: eur
 ---
 
+
 Handling compressed audio is implemented by using [GStreamer](https://gstreamer.freedesktop.org). For licensing reasons, GStreamer binaries aren't compiled and linked with the Speech SDK. Instead, you need to use the prebuilt binaries for Android. To download the prebuilt libraries, see [Installing for Android development](https://gstreamer.freedesktop.org/documentation/installing/for-android-development.html?gi-language=c).
 
 The `libgstreamer_android.so` object is required. Make sure that all the GStreamer plug-ins (from the Android.mk file that follows) are linked in `libgstreamer_android.so`. When you use the Speech SDK with GStreamer version 1.18.3, `libc++_shared.so` is also required to be present from android ndk.

articles/cognitive-services/Speech-Service/includes/how-to/compressed-audio-input/go/prerequisites.md

@@ -1,12 +1,13 @@
 ---
 author: eric-urban
 ms.service: cognitive-services
+ms.subservice: speech-service
 ms.topic: include
-ms.date: 03/09/2020
+ms.date: 04/25/2022
 ms.author: eur
 ---
 
-Handling compressed audio is implemented by using [GStreamer](https://gstreamer.freedesktop.org). For licensing reasons, GStreamer binaries aren't compiled and linked with the Speech SDK. You need to install several dependencies and plug-ins.
+You need to install several dependencies and plug-ins.
 
 # [Ubuntu/Debian](#tab/debian)
 
@@ -31,5 +32,6 @@ gstreamer1-plugins-ugly-free
 > [!NOTE]
 > On RHEL/CentOS 7 and RHEL/CentOS 8, in case of using "ANY" compressed format, more GStreamer plug-ins need to be installed if the stream media format plug-in isn't in the preceding installed plug-ins. 
 
-
 ---
+
+For more information, see [Linux installation instructions](https://gstreamer.freedesktop.org/documentation/installing/on-linux.html?gi-language=c) and [supported Linux distributions and target architectures](~/articles/cognitive-services/speech-service/speech-sdk.md).