Skip to content

Commit b4094eb

Browse files
out_azure_blob: buffering changes (#1632)
* Update azure_kusto.md for buffering commits Signed-off-by: Tanmaya Panda <[email protected]> * Update pipeline/outputs/azure_kusto.md Signed-off-by: esmerel <[email protected]> * out_azure_blob: added buffering changes Signed-off-by: Tanmaya Panda <[email protected]> --------- Signed-off-by: Tanmaya Panda <[email protected]> Signed-off-by: esmerel <[email protected]> Signed-off-by: Tanmaya Panda <[email protected]> Co-authored-by: esmerel <[email protected]>
1 parent d1c77f6 commit b4094eb

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

pipeline/outputs/azure_blob.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,18 @@ We expose different configuration properties. The following table lists all the
3434
| endpoint | If you are using an emulator, this option allows you to specify the absolute HTTP address of such service. e.g: [http://127.0.0.1:10000](http://127.0.0.1:10000). | |
3535
| tls | Enable or disable TLS encryption. Note that Azure service requires this to be turned on. | off |
3636
| workers | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
37+
| buffering\_enabled | Enable buffering into disk before ingesting into Azure Blob. | false |
38+
| buffer\_dir | Specifies the location of directory where the buffered data will be stored. | /tmp/fluent-bit/azure-blob/ |
39+
| upload\_timeout | Optionally specify a timeout for uploads. Fluent Bit will start ingesting buffer files which have been created more than x minutes and haven't reached upload_file_size limit yet. | 30m |
40+
| upload\_file\_size | Specifies the size of files to be uploaded in MBs. | 200M |
41+
| azure\_blob\_buffer\_key | Set the azure blob buffer key which needs to be specified when using multiple instances of azure blob output plugin and buffering is enabled. | key |
42+
| store\_dir\_limit\_size | Set the max size of the buffer directory. | 8G |
43+
| buffer\_file\_delete\_early | Whether to delete the buffered file early after successful blob creation. | false |
44+
| blob\_uri\_length | Set the length of generated blob uri before ingesting to Azure Kusto. | 64 |
45+
| unify\_tag | Whether to create a single buffer file when buffering mode is enabled. | false |
46+
| scheduler\_max\_retries | Maximum number of retries for the scheduler send blob. | 3 |
47+
| delete\_on\_max\_upload\_error | Whether to delete the buffer file on maximum upload errors. | false |
48+
| io\_timeout | HTTP IO timeout. | 60s |
3749

3850
## Getting Started
3951

0 commit comments

Comments
 (0)