From 6a3fedea5099b9d0c2c83b28c7cc143de4cd8c3c Mon Sep 17 00:00:00 2001 From: "Mikhail [azalio] Petrov" Date: Fri, 30 Aug 2024 22:31:59 +0300 Subject: [PATCH 1/2] pipeline: outputs: kinesis: add custom port configuration option This commit introduces a new 'port' configuration option for the Kinesis output plugin. This enhancement allows users to specify a custom TCP port for connecting to the Kinesis Streams service, providing greater flexibility in network configurations. Key changes: - Added 'port' option to the configuration documentation - Updated the Kinesis output plugin to support custom port connections - Maintained default behavior (port 443) when no custom port is specified This feature is particularly useful in environments where non-standard ports are required due to network policies or when connecting through proxies that use alternative ports. The change is backwards compatible, as existing configurations without a specified port will continue to use the default port 443. Signed-off-by: Mikhail [azalio] Petrov --- pipeline/outputs/kinesis.md | 1 + 1 file changed, 1 insertion(+) diff --git a/pipeline/outputs/kinesis.md b/pipeline/outputs/kinesis.md index 14c8d0aa7..bc9fe8718 100644 --- a/pipeline/outputs/kinesis.md +++ b/pipeline/outputs/kinesis.md @@ -25,6 +25,7 @@ See [here](https://github.com/fluent/fluent-bit-docs/tree/43c4fe134611da471e706b | log\_key | By default, the whole log record will be sent to Kinesis. If you specify a key name with this option, then only the value of that key will be sent to Kinesis. For example, if you are using the Fluentd Docker log driver, you can specify `log_key log` and only the log message will be sent to Kinesis. | | role\_arn | ARN of an IAM role to assume \(for cross account access\). | | endpoint | Specify a custom endpoint for the Kinesis API. | +| port | TCP port of the Kinesis Streams service | | sts\_endpoint | Custom endpoint for the STS API. | | auto\_retry\_requests | Immediately retry failed requests to AWS services once. This option does not affect the normal Fluent Bit retry mechanism with backoff. Instead, it enables an immediate retry with no delay for networking errors, which may help improve throughput when there are transient/random networking issues. This option defaults to `true`. | | external\_id | Specify an external ID for the STS API, can be used with the role_arn parameter if your role requires an external ID. | From 8fc16471f57f01093bb491f3b6022ff35e01a792 Mon Sep 17 00:00:00 2001 From: Mikhail Petrov Date: Thu, 26 Sep 2024 19:46:59 +0300 Subject: [PATCH 2/2] Update pipeline/outputs/kinesis.md Co-authored-by: Adam Locke Signed-off-by: Mikhail Petrov --- pipeline/outputs/kinesis.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/outputs/kinesis.md b/pipeline/outputs/kinesis.md index bc9fe8718..e6c64183c 100644 --- a/pipeline/outputs/kinesis.md +++ b/pipeline/outputs/kinesis.md @@ -25,7 +25,7 @@ See [here](https://github.com/fluent/fluent-bit-docs/tree/43c4fe134611da471e706b | log\_key | By default, the whole log record will be sent to Kinesis. If you specify a key name with this option, then only the value of that key will be sent to Kinesis. For example, if you are using the Fluentd Docker log driver, you can specify `log_key log` and only the log message will be sent to Kinesis. | | role\_arn | ARN of an IAM role to assume \(for cross account access\). | | endpoint | Specify a custom endpoint for the Kinesis API. | -| port | TCP port of the Kinesis Streams service | +| port | TCP port of the Kinesis Streams service. Defaults to port `443`. | | sts\_endpoint | Custom endpoint for the STS API. | | auto\_retry\_requests | Immediately retry failed requests to AWS services once. This option does not affect the normal Fluent Bit retry mechanism with backoff. Instead, it enables an immediate retry with no delay for networking errors, which may help improve throughput when there are transient/random networking issues. This option defaults to `true`. | | external\_id | Specify an external ID for the STS API, can be used with the role_arn parameter if your role requires an external ID. |