Skip to content

Commit f0a1ac7

Browse files
out_azure_blob: added buffering changes
Signed-off-by: Tanmaya Panda <[email protected]>
1 parent 412b444 commit f0a1ac7

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

pipeline/outputs/azure_blob.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,18 @@ We expose different configuration properties. The following table lists all the
3232
| endpoint | If you are using an emulator, this option allows you to specify the absolute HTTP address of such service. e.g: [http://127.0.0.1:10000](http://127.0.0.1:10000). | |
3333
| tls | Enable or disable TLS encryption. Note that Azure service requires this to be turned on. | off |
3434
| workers | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
35+
| buffering\_enabled | Enable buffering into disk before ingesting into Azure Blob. | false |
36+
| buffer\_dir | Specifies the location of directory where the buffered data will be stored. | /tmp/fluent-bit/azure-blob/ |
37+
| upload\_timeout | Optionally specify a timeout for uploads. Fluent Bit will start ingesting buffer files which have been created more than x minutes and haven't reached upload_file_size limit yet. | 30m |
38+
| upload\_file\_size | Specifies the size of files to be uploaded in MBs. | 200M |
39+
| azure\_blob\_buffer\_key | Set the azure blob buffer key which needs to be specified when using multiple instances of azure blob output plugin and buffering is enabled. | key |
40+
| store\_dir\_limit\_size | Set the max size of the buffer directory. | 8G |
41+
| buffer\_file\_delete\_early | Whether to delete the buffered file early after successful blob creation. | false |
42+
| blob\_uri\_length | Set the length of generated blob uri before ingesting to Azure Kusto. | 64 |
43+
| unify\_tag | Whether to create a single buffer file when buffering mode is enabled. | false |
44+
| scheduler\_max\_retries | Maximum number of retries for the scheduler send blob. | 3 |
45+
| delete\_on\_max\_upload\_error | Whether to delete the buffer file on maximum upload errors. | false |
46+
| io\_timeout | HTTP IO timeout. | 60s |
3547

3648
## Getting Started
3749

0 commit comments

Comments
 (0)