You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1:k8s cluster with four node,there has a openresty,and some services be collected log。
2:openresty has thousands QPS,and collect log in access.log。openresty has a busybus container in the pod,and the pod collect the log with command "tail -F {logPATH}"。
3:start fluentd with daemonset controller, and collect the log to es。
With sometimes, there will have some log repat in the es。
there is the version of my struction
quay.io/fluentd_elasticsearch/fluentd:v3.4.0
docker.elastic.co/elasticsearch/elasticsearch:7.6.2
docker.elastic.co/kibana/kibana:7.6.2
what this can't be?
and there is some error in my fluentd log.
"message":"dump an error event: error_class=Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError error="400 - Rejected by Elasticsearch [error type]: illegal_argument_exception [reason]: 'Limit of mapping depth [20] in index [k8s-fluentd-default-2022.08.15-000117] has been exceeded due to object field
"message":"dump an error event: error_class=Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError error="400 - Rejected by Elasticsearch [error type]: illegal_argument_exception [reason]: 'Limit of total fields [1000] in index [k8s-fluentd-default-2022.08.15-000117] has been exceeded
"message":"dump an error event: error_class=ArgumentError error="string length (3852) exceeds the limit 128" location="/usr/local/bundle/gems/fluent-plugin-elasticsearch-5.1.4/lib/fluent/plugin/out_elasticsearch.rb:562:in
`parse'" tag="Fluent::ElasticsearchOutput::TimeParser.error" time=2022-08-16 06:36:26.646490456 +0000
record={"tag"=>"kubernetes.var.log.containers.fluentd-es-4fjrg_logging_fluentd-es-77ba954163c39d56d66af8b3019464136e8ebddda089aa1a8c8094c4d2031043.log"
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
1:k8s cluster with four node,there has a openresty,and some services be collected log。
2:openresty has thousands QPS,and collect log in access.log。openresty has a busybus container in the pod,and the pod collect the log with command "tail -F {logPATH}"。
3:start fluentd with daemonset controller, and collect the log to es。
With sometimes, there will have some log repat in the es。
there is the version of my struction
quay.io/fluentd_elasticsearch/fluentd:v3.4.0
docker.elastic.co/elasticsearch/elasticsearch:7.6.2
docker.elastic.co/kibana/kibana:7.6.2
what this can't be?
and there is some error in my fluentd log.
"message":"dump an error event: error_class=Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError error="400 - Rejected by Elasticsearch [error type]: illegal_argument_exception [reason]: 'Limit of mapping depth [20] in index [k8s-fluentd-default-2022.08.15-000117] has been exceeded due to object field
"message":"dump an error event: error_class=Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError error="400 - Rejected by Elasticsearch [error type]: illegal_argument_exception [reason]: 'Limit of total fields [1000] in index [k8s-fluentd-default-2022.08.15-000117] has been exceeded
"message":"dump an error event: error_class=ArgumentError error="string length (3852) exceeds the limit 128" location="/usr/local/bundle/gems/fluent-plugin-elasticsearch-5.1.4/lib/fluent/plugin/out_elasticsearch.rb:562:in
`parse'" tag="Fluent::ElasticsearchOutput::TimeParser.error" time=2022-08-16 06:36:26.646490456 +0000
record={"tag"=>"kubernetes.var.log.containers.fluentd-es-4fjrg_logging_fluentd-es-77ba954163c39d56d66af8b3019464136e8ebddda089aa1a8c8094c4d2031043.log"
Beta Was this translation helpful? Give feedback.
All reactions