Skip to content

Commit 2af7c3c

Browse files
authored
Merge pull request #208197 from HeidiSteen/heidist-synapse
[cognitive services] Style updates to big data concept and get-started articles
2 parents 9383980 + 3bab6ad commit 2af7c3c

10 files changed

+117
-87
lines changed

articles/cognitive-services/TOC.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@
8787
href: ./security-controls-policy.md
8888
- name: Use with big data
8989
items:
90-
- name: Cognitive Services for Big Data
90+
- name: Cognitive Services for big data
9191
href: ./big-data/cognitive-services-for-big-data.md
9292
- name: Getting started
9393
href: ./big-data/getting-started.md

articles/cognitive-services/big-data/cognitive-services-for-big-data.md

Lines changed: 32 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
2-
title: "Cognitive Services for Big Data"
3-
description: Learn how to leverage Azure Cognitive Services on large datasets using Python, Java, and Scala. With Cognitive Services for Big Data you can embed continuously improving, intelligent models directly into Apache Spark™ and SQL computations.
2+
title: "Cognitive Services for big data"
3+
description: Learn how to leverage Azure Cognitive Services on large datasets using Python, Java, and Scala. With Cognitive Services for big data you can embed continuously improving, intelligent models directly into Apache Spark™ and SQL computations.
44
services: cognitive-services
55
author: mhamilton723
66
manager: nitinme
@@ -10,21 +10,21 @@ ms.date: 10/28/2021
1010
ms.author: marhamil
1111
---
1212

13-
# Azure Cognitive Services for Big Data
13+
# Azure Cognitive Services for big data
1414

15-
![Azure Cognitive Services for Big Data](media/cognitive-services-big-data-overview.svg)
15+
![Azure Cognitive Services for big data](media/cognitive-services-big-data-overview.svg)
1616

17-
The Azure Cognitive Services for Big Data lets users channel terabytes of data through Cognitive Services using [Apache Spark™](/dotnet/spark/what-is-spark). With the Cognitive Services for Big Data, it's easy to create large-scale intelligent applications with any datastore.
17+
Azure Cognitive Services for big data lets users channel terabytes of data through Cognitive Services using [Apache Spark™](/dotnet/spark/what-is-spark) and open source libraries for distributed machine learning workloads. With Cognitive Services for big data, it's easy to create large-scale intelligent applications with any datastore.
1818

19-
With Cognitive Services for Big Data you can embed continuously improving, intelligent models directly into Apache Spark™ and SQL computations. These tools liberate developers from low-level networking details, so that they can focus on creating smart, distributed applications.
19+
Using the resources and libraries described in this article, you can embed continuously improving, intelligent models directly into Apache Spark™ and SQL computations. These tools liberate developers from low-level networking details, so that they can focus on creating smart, distributed applications.
2020

2121
## Features and benefits
2222

23-
Cognitive Services for Big Data can use services from any region in the world, as well as [containerized Cognitive Services](../cognitive-services-container-support.md). Containers support low or no connectivity deployments with ultra-low latency responses. Containerized Cognitive Services can be run locally, directly on the worker nodes of your Spark cluster, or on an external orchestrator like Kubernetes.
23+
Cognitive Services for big data can use resources from any [supported region](https://azure.microsoft.comglobal-infrastructure/services/?products=cognitive-services), as well as [containerized Cognitive Services](../cognitive-services-container-support.md). Containers support low or no connectivity deployments with ultra-low latency responses. Containerized Cognitive Services can be run locally, directly on the worker nodes of your Spark cluster, or on an external orchestrator like Kubernetes.
2424

2525
## Supported services
2626

27-
[Cognitive Services](../index.yml), accessed through APIs and SDKs, help developers build intelligent applications without having AI or data science skills. With Cognitive Services you can make your applications see, hear, speak, understand, and reason. To use the Cognitive Services, your application must send data to the service over the network. Once received, the service sends an intelligent response in return. The following services are available for big data workloads:
27+
[Cognitive Services](../index.yml), accessed through APIs and SDKs, help developers build intelligent applications without having AI or data science skills. With Cognitive Services you can make your applications see, hear, speak, understand, and reason. To use Cognitive Services, your application must send data to the service over the network. Once received, the service sends an intelligent response in return. The following Cognitive Services resources are available for big data workloads:
2828

2929
### Vision
3030

@@ -57,21 +57,35 @@ Cognitive Services for Big Data can use services from any region in the world, a
5757
|:-----------|:------------------|
5858
|[Bing Image Search](/azure/cognitive-services/bing-image-search "Bing Image Search")|The Bing Image Search service returns a display of images determined to be relevant to the user's query.|
5959

60-
## Supported programming languages for Cognitive Services for Big Data
60+
## Supported programming languages for Cognitive Services for big data
6161

62-
The Cognitive Services for Big Data are built on Apache Spark. Apache Spark is a distributed computing library that supports Java, Scala, Python, R, and many other languages. These languages are currently supported.
62+
Cognitive Services for big data are built on Apache Spark. Apache Spark is a distributed computing library that supports Java, Scala, Python, R, and many other languages. See [SynapseML](https://microsoft.github.io/SynapseML) for documentation, samples, and blog posts.
63+
64+
The following languages are currently supported.
6365

6466
### Python
6567

66-
We provide a PySpark API in the `mmlspark.cognitive` namespace of [Microsoft ML for Apache Spark](https://aka.ms/spark). For more information, see the [Python Developer API](https://mmlspark.blob.core.windows.net/docs/1.0.0-rc1/pyspark/mmlspark.cognitive.html). For usage examples, see the [Python Samples](samples-python.md).
68+
We provide a PySpark API for current and legacy libraries:
69+
70+
* [`synapseml.cognitive`](https://mmlspark.blob.core.windows.net/docs/0.10.0/pyspark/synapse.ml.cognitive.html)
71+
72+
* [`mmlspark.cognitive`](https://mmlspark.blob.core.windows.net/docs/0.18.1/pyspark/modules.html)
73+
74+
For more information, see the [Python Developer API](https://mmlspark.blob.core.windows.net/docs/1.0.0-rc1/pyspark/mmlspark.cognitive.html). For usage examples, see the [Python Samples](samples-python.md).
6775

6876
### Scala and Java
6977

70-
We provide a Scala and Java-based Spark API in the `com.microsoft.ml.spark.cognitive` namespace of [Microsoft ML for Apache Spark](https://aka.ms/spark). For more information, see the [Scala Developer API](https://mmlspark.blob.core.windows.net/docs/1.0.0-rc1/scala/index.html#package). For usage examples, see the [Scala Samples](samples-scala.md).
78+
We provide a Scala and Java-based Spark API for current and legacy libraries:
79+
80+
* [`com.microsoft.synapseml.cognitive`](https://mmlspark.blob.core.windows.net/docs/0.10.0/scala/com/microsoft/azure/synapse/ml/cognitive/index.html)
81+
82+
* [`com.microsoft.ml.spark.cognitive`](https://mmlspark.blob.core.windows.net/docs/0.18.1/scala/index.html#com.microsoft.ml.spark.cognitive.package)
83+
84+
For more information, see the [Scala Developer API](https://mmlspark.blob.core.windows.net/docs/1.0.0-rc1/scala/index.html#package). For usage examples, see the [Scala Samples](samples-scala.md).
7185

7286
## Supported platforms and connectors
7387

74-
The Cognitive Services for Big Data requires Apache Spark. There are several Apache Spark platforms that support the Cognitive Services for Big Data.
88+
Big data scenarios require Apache Spark. There are several Apache Spark platforms that support Cognitive Services for big data.
7589

7690
### Azure Databricks
7791

@@ -100,15 +114,15 @@ The basis of Spark is the DataFrame: a tabular collection of data distributed ac
100114
- Do SQL-style computations such as join and filter tables.
101115
- Apply functions to large datasets using MapReduce style parallelism.
102116
- Apply Distributed Machine Learning using Microsoft Machine Learning for Apache Spark.
103-
- Use the Cognitive Services for Big Data to enrich your data with ready-to-use intelligent services.
117+
- Use Cognitive Services for big data to enrich your data with ready-to-use intelligent services.
104118

105119
### Microsoft Machine Learning for Apache Spark (MMLSpark)
106120

107-
[Microsoft Machine Learning for Apache Spark](https://mmlspark.blob.core.windows.net/website/index.html#install) (MMLSpark) is an open-source, distributed machine learning library (ML) built on Apache Spark. The Cognitive Services for Big Data is included in this package. Additionally, MMLSpark contains several other ML tools for Apache Spark, such as LightGBM, Vowpal Wabbit, OpenCV, LIME, and more. With MMLSpark, you can build powerful predictive and analytical models from any Spark datasource.
121+
[Microsoft Machine Learning for Apache Spark](https://mmlspark.blob.core.windows.net/website/index.html#install) (MMLSpark) is an open-source, distributed machine learning library (ML) built on Apache Spark. Cognitive Services for big data is included in this package. Additionally, MMLSpark contains several other ML tools for Apache Spark, such as LightGBM, Vowpal Wabbit, OpenCV, LIME, and more. With MMLSpark, you can build powerful predictive and analytical models from any Spark datasource.
108122

109123
### HTTP on Spark
110124

111-
Cognitive Services for Big Data is an example of how we can integrate intelligent web services with big data. Web services power many applications across the globe and most services communicate through the Hypertext Transfer Protocol (HTTP). To work with *arbitrary* web services at large scales, we provide HTTP on Spark. With HTTP on Spark, you can pass terabytes of data through any web service. Under the hood, we use this technology to power Cognitive Services for Big Data.
125+
Cognitive Services for big data is an example of how we can integrate intelligent web services with big data. Web services power many applications across the globe and most services communicate through the Hypertext Transfer Protocol (HTTP). To work with *arbitrary* web services at large scales, we provide HTTP on Spark. With HTTP on Spark, you can pass terabytes of data through any web service. Under the hood, we use this technology to power Cognitive Services for big data.
112126

113127
## Developer samples
114128

@@ -126,11 +140,11 @@ Cognitive Services for Big Data is an example of how we can integrate intelligen
126140

127141
- [The Azure Cognitive Services on Spark: Clusters with Embedded Intelligent Services](https://databricks.com/session/the-azure-cognitive-services-on-spark-clusters-with-embedded-intelligent-services)
128142
- [Spark Summit Keynote: Scalable AI for Good](https://databricks.com/session_eu19/scalable-ai-for-good)
129-
- [The Cognitive Services for Big Data in Cosmos DB](https://medius.studios.ms/Embed/Video-nc/B19-BRK3004?latestplayer=true&l=2571.208093)
143+
- [Cognitive Services for big data in Cosmos DB](https://medius.studios.ms/Embed/Video-nc/B19-BRK3004?latestplayer=true&l=2571.208093)
130144
- [Lightning Talk on Large Scale Intelligent Microservices](https://www.youtube.com/watch?v=BtuhmdIy9Fk&t=6s)
131145

132146
## Next steps
133147

134-
- [Getting Started with the Cognitive Services for Big Data](getting-started.md)
148+
- [Getting Started with Cognitive Services for big data](getting-started.md)
135149
- [Simple Python Examples](samples-python.md)
136150
- [Simple Scala Examples](samples-scala.md)

0 commit comments

Comments
 (0)