You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/speech-service/includes/release-notes/release-notes-stt.md
+14-2Lines changed: 14 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,11 +1,23 @@
1
-
---
2
1
author: eric-urban
3
2
ms.service: azure-ai-speech
4
3
ms.topic: include
5
-
ms.date: 11/19/2024
4
+
ms.date: 1/21/2025
6
5
ms.author: eur
7
6
---
8
7
8
+
### January 2025 release
9
+
10
+
#### Real-time speech to text - New English model release
11
+
12
+
Announcing the release of the latest English speech model (en-US, en-CA), which brings substantial improvements across various performance metrics. Below are the key highlights of this release:
13
+
- Accessibility Enhancements: Achieved a 36% reduction in Word Error Rate (WER) on Microsoft internal accessibility test sets, making speech recognition more accurate and reliable for recognizing speech from individuals with speech disabilities.
14
+
-
15
+
- Ghost Word Reduction: A remarkable 90% reduction in ghost words on the ghost word development set and reductions range from 63% to 100% across other ghost word datasets, significantly enhancing the clarity and accuracy of transcriptions.
16
+
-
17
+
The new model also improved the overall performance, including entity recognition and better recognition of spelled-out letters.
18
+
19
+
These advancements are expected to provide a more accurate, efficient, and satisfying experience for all users. The new model is available through the API and Azure AI Foundry playground. Feedback is encouraged to further refine its capabilities.
Copy file name to clipboardExpand all lines: articles/machine-learning/v1/how-to-configure-databricks-automl-environment.md
+27-28Lines changed: 27 additions & 28 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.author: manashg
8
8
ms.reviewer: ssalgado
9
9
ms.service: azure-machine-learning
10
10
ms.subservice: automl
11
-
ms.date: 10/21/2021
11
+
ms.date: 01/21/2025
12
12
ms.topic: how-to
13
13
ms.custom: UpdateFrequency5
14
14
monikerRange: 'azureml-api-1'
@@ -18,7 +18,7 @@ monikerRange: 'azureml-api-1'
18
18
19
19
Learn how to configure a development environment in Azure Machine Learning that uses Azure Databricks and automated ML.
20
20
21
-
Azure Databricks is ideal for running large-scale intensive machine learning workflows on the scalable Apache Spark platform in the Azure cloud. It provides a collaborative Notebook-based environment with a CPU or GPU-based compute cluster.
21
+
Azure Databricks is ideal for running large-scale intensive machine learning workflows on the scalable Apache Spark platform in the Azure cloud. It provides a collaborative Notebook-based environment with a CPU or GPU-based compute resource.
22
22
23
23
For information on other machine learning development environments, see [Set up Python development environment](how-to-configure-environment.md).
24
24
@@ -38,36 +38,36 @@ You can use Azure Databricks:
38
38
+ With [automated machine learning](concept-automated-ml.md) capabilities using an Azure Machine Learning SDK.
39
39
+ As a compute target from an [Azure Machine Learning pipeline](../concept-ml-pipelines.md).
40
40
41
-
## Set up a Databricks cluster
41
+
## Set up Databricks compute
42
42
43
-
Create a [Databricks cluster](/azure/databricks/scenarios/quickstart-create-databricks-workspace-portal). Some settings apply only if you install the SDK for automated machine learning on Databricks.
43
+
Create a [Databricks compute resource](/azure/databricks/compute/configure#create-a-new-all-purpose-compute-resource). Some settings apply only if you install the SDK for automated machine learning on Databricks.
44
44
45
-
**It takes few minutes to create the cluster.**
45
+
**It takes few minutes to create the compute resource.**
46
46
47
47
Use these settings:
48
48
49
49
| Setting |Applies to| Value |
50
50
|----|---|---|
51
-
|Cluster Name |always|yourclustername|
51
+
|Compute Name |always|yourcomputename|
52
52
| Databricks Runtime Version |always| 9.1 LTS|
53
53
| Python version |always| 3 |
54
54
| Worker Type <br>(determines max # of concurrent iterations) |Automated ML<br>only| Memory optimized VM preferred |
Wait until the cluster is running before proceeding further.
58
+
Wait until the compute is running before proceeding further.
59
59
60
60
## Add the Azure Machine Learning SDK to Databricks
61
61
62
-
Once the cluster is running, [create a library](https://docs.databricks.com/user-guide/libraries.html#create-a-library) to attach the appropriate Azure Machine Learning SDK package to your cluster.
62
+
Once the compute is running, [create a library](https://docs.databricks.com/user-guide/libraries.html#create-a-library) to attach the appropriate Azure Machine Learning SDK package to your compute.
63
63
64
64
To use automated ML, skip to [Add the Azure Machine Learning SDK with AutoML](#add-the-azure-machine-learning-sdk-with-automl-to-databricks).
65
65
66
66
67
67
1. Right-click the current Workspace folder where you want to store the library. Select **Create** > **Library**.
68
68
69
69
> [!TIP]
70
-
> If you have an old SDK version, deselect it from cluster's installed libraries and move to trash. Install the new SDK version and restart the cluster. If there is an issue after the restart, detach and reattach your cluster.
70
+
> If you have an old SDK version, deselect it from compute's installed libraries and move to trash. Install the new SDK version and restart the compute. If there is an issue after the restart, detach and reattach your compute.
71
71
72
72
1. Choose the following option (no other SDK installations are supported)
73
73
@@ -78,22 +78,20 @@ To use automated ML, skip to [Add the Azure Machine Learning SDK with AutoML](#a
78
78
> [!WARNING]
79
79
> No other SDK extras can be installed. Choose only the [`databricks`] option .
80
80
81
-
* Do not select **Attach automatically to all clusters**.
82
-
* Select **Attach** next to your cluster name.
81
+
* Do not select **Attach automatically to all computes**.
82
+
* Select **Attach** next to your compute name.
83
83
84
84
1. Monitor for errors until status changes to **Attached**, which may take several minutes. If this step fails:
85
85
86
-
Try restarting your cluster by:
87
-
1. In the left pane, select **Clusters**.
88
-
1. In the table, select your cluster name.
86
+
Try restarting your compute by:
87
+
1. In the left pane, select **Compute**.
88
+
1. In the table, select your compute name.
89
89
1. On the **Libraries** tab, select **Restart**.
90
-
91
-
A successful install looks like the following:
92
-
93
-

90
+
91
+
A successful install will show **Installed** under the status column.
94
92
95
93
## Add the Azure Machine Learning SDK with AutoML to Databricks
96
-
If the cluster was created with Databricks Runtime 7.3 LTS (*not* ML), run the following command in the first cell of your notebook to install the Azure Machine Learning SDK.
94
+
If the compute was created with Databricks Runtime 7.3 LTS (*not* ML), run the following command in the first cell of your notebook to install the Azure Machine Learning SDK.
@@ -103,23 +101,24 @@ If the cluster was created with Databricks Runtime 7.3 LTS (*not* ML), run the f
103
101
104
102
In AutoML config, when using Azure Databricks add the following parameters:
105
103
106
-
-```max_concurrent_iterations``` is based on number of worker nodes in your cluster.
104
+
-```max_concurrent_iterations``` is based on number of worker nodes in your compute.
107
105
-```spark_context=sc``` is based on the default spark context.
108
106
109
107
## ML notebooks that work with Azure Databricks
110
108
111
109
Try it out:
112
110
+ While many sample notebooks are available, **only [these sample notebooks](https://github.com/Azure/azureml-examples/tree/v1-archive/v1/python-sdk/tutorials/automl-with-databricks) work with Azure Databricks.**
113
111
114
-
+ Import these samples directly from your workspace. See below:
+ Import these samples directly from your workspace:
113
+
1. In your workspace, right-click a folder and select **Import**.
114
+
1. Specify the URL or browse to a file containing a supported external format or a ZIP archive of notebooks exported from a Databricks workspace.
115
+
1. Select **Import**.
117
116
118
117
+ Learn how to [create a pipeline with Databricks as the training compute](how-to-create-machine-learning-pipelines.md).
119
118
120
119
## Troubleshooting
121
120
122
-
***Databricks cancel an automated machine learning run**: When you use automated machine learning capabilities on Azure Databricks, to cancel a run and start a new experiment run, restart your Azure Databricks cluster.
121
+
***Databricks cancel an automated machine learning run**: When you use automated machine learning capabilities on Azure Databricks, to cancel a run and start a new experiment run, restart your Azure Databricks compute.
123
122
124
123
***Databricks >10 iterations for automated machine learning**: In automated machine learning settings, if you have more than 10 iterations, set `show_output` to `False` when you submit the run.
125
124
@@ -147,18 +146,18 @@ Try it out:
147
146
148
147
* **Import error: No module named 'pandas.core.indexes'**: If you see this error when you use automated machine learning:
149
148
150
-
1. Run this command to install two packages in your Azure Databricks cluster:
149
+
1. Run this command to install two packages in your Azure Databricks compute:
151
150
152
151
```bash
153
152
scikit-learn==0.19.1
154
153
pandas==0.22.0
155
154
```
156
155
157
-
1. Detach and then reattach the cluster to your notebook.
156
+
1. Detach and then reattach the compute to your notebook.
158
157
159
-
If these steps don't solve the issue, try restarting the cluster.
158
+
If these steps don't solve the issue, try restarting the compute.
160
159
161
-
* **FailToSendFeather**: If you see a `FailToSendFeather` error when reading data on Azure Databricks cluster, refer to the following solutions:
160
+
* **FailToSendFeather**: If you see a `FailToSendFeather` error when reading data on Azure Databricks compute, refer to the following solutions:
162
161
163
162
* Upgrade `azureml-sdk[automl]` package to the latest version.
0 commit comments