You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-explorer/lightingest.md
+18-7Lines changed: 18 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,3 +1,14 @@
1
+
---
2
+
title: LightIngest
3
+
description: Learn about LightIngest, a command-line utility for ad-hoc data ingestion into Kusto
4
+
author: orspod
5
+
ms.author: orspodek
6
+
ms.reviewer: tzgitlin
7
+
ms.service: data-explorer
8
+
ms.topic: conceptual
9
+
ms.date: 03/17/2020
10
+
---
11
+
1
12
# LightIngest
2
13
3
14
LightIngest is a command-line utility for ad-hoc data ingestion into Kusto.
@@ -6,7 +17,7 @@ The utility can pull source data from a local folder or from an Azure blob stora
6
17
## Prerequisites
7
18
8
19
* LightIngest - download it as part of the [Microsoft.Azure.Kusto.Tools NuGet package](https://www.nuget.org/packages/Microsoft.Azure.Kusto.Tools/)
9
-
* WinRAR - download it from [www.win-rar.com/download.html](www.win-rar.com/download.html)
20
+
* WinRAR - download it from [www.win-rar.com/download.html](http://www.win-rar.com/download.html)
10
21
11
22
## Install LightIngest
12
23
@@ -29,7 +40,7 @@ The utility can pull source data from a local folder or from an Azure blob stora
29
40
>
30
41
31
42
1. (Mandatory) Enter `LightIngest` followed by the connection string to the Kusto cluster that will manage the ingestion.
32
-
The connection string should be enclosed in double quotes and follow the [Kusto connection strings specification](../api/connection-strings/kusto.md).
43
+
The connection string should be enclosed in double quotes and follow the [Kusto connection strings specification](https://docs.microsoft.com/azure/kusto/api/connection-strings/kusto).
33
44
34
45
For example:
35
46
```
@@ -44,17 +55,17 @@ The utility can pull source data from a local folder or from an Azure blob stora
44
55
45
56
|Argument name |Short name |Type |Mandatory |Description |
| | |string |Mandatory |[Kusto Connection String](../api/connection-strings/kusto.md) specifying the Kusto endpoint that will handle the ingestion. Should be enclosed in double quotes |
58
+
| | |string |Mandatory |[Kusto Connection String](https://docs.microsoft.com/azure/kusto/api/connection-strings/kusto) specifying the Kusto endpoint that will handle the ingestion. Should be enclosed in double quotes |
48
59
|-database |-db |string |Optional |Target Kusto database name |
49
60
|-table | |string |Mandatory |Target Kusto table name |
50
61
|-sourcePath |-source |string |Mandatory |Path to source files or root URI of the blob container. If the data is in blobs, must contain storage account key or SAS. Recommended to enclose in double quotes |
51
62
|-prefix | |string |Optional |When the source data to ingest resides on blob storage, this URL prefix is shared by all blobs, excluding the container name. For example, if the data is in `MyContainer/Dir1/Dir2`, then the prefix should be `Dir1/Dir2`. Enclosing in double quotes is recommended |
52
63
|-pattern | |string |Optional |Pattern by which source files/blobs are picked. Supports wildcards. For example, `"*.csv"`. Recommended to enclose in double quotes |
53
-
|-format |-f |string |Optional |Source data format. Must be one of the [supported formats](../management/data-ingestion/index.md#supported-data-formats) |
54
-
|-ingestionMappingPath |-mappingPath |string |Optional |Path to ingestion column-mapping file (mandatory for Json and Avro formats). See [data mappings](../management/mappings.md) |
55
-
|-ingestionMappingRef |-mappingRef |string |Optional |Name of a pre-created ingestion column mapping (mandatory for Json and Avro formats). See [data mappings](../management/mappings.md) |
64
+
|-format |-f |string |Optional |Source data format. Must be one of the [supported formats](https://docs.microsoft.com/azure/kusto/management/data-ingestion/#supported-data-formats) |
65
+
|-ingestionMappingPath |-mappingPath |string |Optional |Path to ingestion column-mapping file (mandatory for Json and Avro formats). See [data mappings](https://docs.microsoft.com/azure/kusto/management/mappings) |
66
+
|-ingestionMappingRef |-mappingRef |string |Optional |Name of a pre-created ingestion column mapping (mandatory for Json and Avro formats). See [data mappings](https://docs.microsoft.com/azure/kusto/management/mappings) |
56
67
|-ignoreFirstRow |-ignoreFirst |bool |Optional |If set, the first record of each file/blob is ignored (for example, if the source data has headers) |
57
-
|-tag | |string |Optional |[Tags](../management/extents-overview.md#extent-tagging) to associate with the ingested data. Multiple occurrences are permitted |
68
+
|-tag | |string |Optional |[Tags](https://docs.microsoft.com/azure/kusto/management/extents-overview#extent-tagging) to associate with the ingested data. Multiple occurrences are permitted |
58
69
|-dontWait | |bool |Optional |If set to 'true', does not wait for ingestion completion. Useful when ingesting large amounts of files/blobs |
0 commit comments