You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# Data Science Virtual Machine data ingestion tools
17
17
18
-
As one of the first technical steps in a data science or AI project, you must identify the datasets to be used and bring them into your analytics environment. The Data Science Virtual Machine (DSVM) provides tools and libraries to bring data from different sources into analytical data storage locally on the DSVM, or into a data platform either on the cloud or on-premises.
18
+
At an early stage in a data science or AI project, you must identify the needed datasets, and then bring them into your analytics environment. The Data Science Virtual Machine (DSVM) provides tools and libraries to bring data from different sources into local analytical data storage resources on the DSVM. The DSVM can also bring data into a data platform located either on the cloud or on-premises.
19
19
20
-
Here are some data movement tools that are available in the DSVM.
20
+
The DSVM offers these data movement tools:
21
21
22
22
## Azure CLI
23
23
24
24
| Category | Value |
25
25
|--|--|
26
-
| What is it? | A management tool for Azure. It also contains command verbs to move data from Azure data platforms like Azure Blob storage and Azure Data Lake Store.|
26
+
| What is it? | A management tool for Azure. It offers command verbs to move data from Azure data platforms - for example, Azure Blob storage and Azure Data Lake Store |
27
27
| Supported DSVM versions | Windows, Linux |
28
-
| Typical uses |Importing and exporting data to and from Azure Storage and Azure Data Lake Store.|
29
-
| How to use / run it? | Open a command prompt and type `az` to get help. |
28
+
| Typical uses |Import and export data between Azure Storage and Azure Data Lake Store |
29
+
| How to use / run it? | Open a command prompt, and type `az` to get help. |
30
30
| Links to samples |[Using Azure CLI](/cli/azure)|
31
31
32
-
33
32
## AzCopy
34
33
35
34
| Category | Value |
36
35
|--|--|
37
-
| What is it? | A tool to copy data to and from local files, Azure Blob storage, files, and tables.|
36
+
| What is it? | A tool to copy data between local files, Azure Blob storage, files, and tables |
38
37
| Supported DSVM versions | Windows |
39
-
| Typical uses |Copying files to Azure Blob storage and copying blobs between accounts.|
40
-
| How to use / run it? | Open a command prompt and type `azcopy` to get help. |
38
+
| Typical uses |Copy files to Azure Blob storage<br>Copy blobs between accounts |
39
+
| How to use / run it? | Open a command prompt, and type `azcopy` to get help. |
41
40
| Links to samples |[AzCopy on Windows](../../storage/common/storage-use-azcopy-v10.md)|
42
41
43
-
44
42
## Azure Cosmos DB Data Migration tool
45
43
46
44
|--|--|
47
45
| ------------- | ------------- |
48
-
| What is it? | Tool to import data from various sources into Azure Cosmos DB, a NoSQL database in the cloud. These sources include JSON files, CSV files, SQL, MongoDB, Azure Table storage, Amazon DynamoDB, and Azure Cosmos DB for NoSQL collections.|
46
+
| What is it? | Tool to import data from various sources into Azure Cosmos DB, a NoSQL database in the cloud. These sources include JSON files<br>CSV files<br>SQL<br>MongoDB<br>Azure Table storage<br>Amazon DynamoDB<br>Azure Cosmos DB for NoSQL collections |
49
47
| Supported DSVM versions | Windows |
50
-
| Typical uses |Importing files from a VM to Azure Cosmos DB, importing data from Azure table storage to Azure Cosmos DB, and importing data from a Microsoft SQL Server database to Azure Cosmos DB.|
51
-
| How to use / run it? | To use the command-line version, open a command prompt and type `dt`. To use the GUI tool, open a command prompt and type `dtui`.|
48
+
| Typical uses |Import files from a VM to Azure Cosmos DB<br>import data from Azure table storage to Azure Cosmos DB<br>import data from a Microsoft SQL Server database to Azure Cosmos DB |
49
+
| How to use / run it? | To use the command-line version, open a command prompt and type `dt`. To use the GUI tool, open a command prompt and type `dtui`|
52
50
| Links to samples |[Import data into Azure Cosmos DB](../../cosmos-db/import-data.md)|
53
51
54
52
## Azure Storage Explorer
55
53
56
54
| Category | Value |
57
55
|--|--|
58
-
| What is it? | Graphical User Interface for interacting with files stored in the Azure cloud.|
56
+
| What is it? | Graphical User Interface to interact with files stored in the Azure cloud |
59
57
| Supported DSVM versions | Windows |
60
-
| Typical uses |Importing and exporting data from the DSVM.|
61
-
| How to use / run it? | Search for "Azure Storage Explorer" in the Start menu.|
58
+
| Typical uses |Import data to and export data from the DSVM |
59
+
| How to use / run it? | Search for "Azure Storage Explorer" in the Start menu |
62
60
| Links to samples |[Azure Storage Explorer](vm-do-ten-things.md#access-azure-data-and-analytics-services)|
63
61
64
62
## bcp
65
63
66
64
| Category | Value |
67
65
|--|--|
68
-
| What is it? | SQL Server tool to copy data between SQL Server and a data file.|
66
+
| What is it? | SQL Server tool to copy data between SQL Server and a data file |
69
67
| Supported DSVM versions | Windows |
70
-
| Typical uses |Importing a CSV file into a SQL Server table and exporting a SQL Server table to a file.|
71
-
| How to use / run it? | Open a command prompt and type `bcp` to get help.|
68
+
| Typical uses |Import a CSV file into a SQL Server table<br>Export a SQL Server table to a file |
69
+
| How to use / run it? | Open a command prompt, and type `bcp` to get help |
72
70
| Links to samples |[bcp utility](/sql/tools/bcp-utility)|
73
71
74
72
## blobfuse
75
73
76
74
| Category | Value |
77
75
|--|--|
78
-
| What is it? | A tool to mount an Azure Blob storage container in the Linux file system.|
76
+
| What is it? | A tool to mount an Azure Blob storage container in the Linux file system |
79
77
| Supported DSVM versions | Linux |
80
-
| Typical uses |Reading and writing to blobs in a container.|
81
-
| How to use and run it? | Run _blobfuse_ at a terminal.|
82
-
| Links to samples |[blobfuse on GitHub](https://github.com/Azure/azure-storage-fuse)|
78
+
| Typical uses |Read from and write to blobs in a container |
79
+
| How to use and run it? | Run _blobfuse_ at a terminal |
80
+
| Links to samples |[blobfuse on GitHub](https://github.com/Azure/azure-storage-fuse)|
0 commit comments