Can the elasticsearch-logger plugin index index concatenate the current date?

[myhgc]

Can the elasticsearch-logger plugin index index concatenate the current date?

[dosubot[bot]]

Yes, the elasticsearch-logger plugin can concatenate the current date to the index. You can use Nginx variables to achieve this. For example, you can set the field.index attribute to include the current date:

{
    "plugins": {
        "elasticsearch-logger": {
            "endpoint_addrs": ["http://127.0.0.1:9200"],
            "field": {
                "index": "services-$time_iso8601",
                "type": "collector"
            },
            "auth": {
                "username": "elastic",
                "password": "123456"
            },
            "ssl_verify": false,
            "timeout": 60,
            "retry_delay": 1,
            "buffer_duration": 60,
            "max_retry_count": 0,
            "batch_max_size": 1000,
            "inactive_timeout": 5,
            "name": "elasticsearch-logger"
        }
    },
    "upstream": {
        "type": "roundrobin",
        "nodes": {
            "127.0.0.1:1980": 1
        }
    },
    "uri": "/elasticsearch.do"
}

In this example, the field.index is set to services-$time_iso8601, which will concatenate the current date and time to the index name. Note that endpoint_addr is deprecated and should be replaced with endpoint_addrs ^[1][2].

To continue talking to Dosu, mention @dosu.

[dosubot[bot]]

To correctly use the $time_iso8601 variable in the field.index for the elasticsearch-logger plugin so that it is recognized as an Nginx date variable, you should configure it in the log_format attribute. Here is an example configuration:

{
    "plugins": {
        "elasticsearch-logger": {
            "endpoint_addr": "http://127.0.0.1:9200",
            "field": {
                "index": "services",
                "type": "collector"
            },
            "log_format": {
                "@timestamp": "$time_iso8601"
            },
            "auth": {
                "username": "elastic",
                "password": "123456"
            },
            "ssl_verify": false,
            "timeout": 60,
            "retry_delay": 1,
            "buffer_duration": 60,
            "max_retry_count": 0,
            "batch_max_size": 1000,
            "inactive_timeout": 5,
            "name": "elasticsearch-logger"
        }
    },
    "upstream": {
        "type": "roundrobin",
        "nodes": {
            "127.0.0.1:1980": 1
        }
    },
    "uri": "/elasticsearch.do"
}

In this configuration, the log_format attribute is used to specify the format of the logs, and the $time_iso8601 variable is correctly recognized as an Nginx date variable. Note that the endpoint_addr attribute is used as per the latest documentation. The log_format values only support strings, and Nginx variables can be used by prefixing the string with $ ^{[1][2][3][4][5]}.

To continue talking to Dosu, mention @dosu.

[myhgc]

@dosu field.index concatenate the current date ,just like :
"field": {
"index": "services-2024.09.19",
"type": "collector"
}

[dosubot[bot]]

To configure field.index in the elasticsearch-logger plugin to concatenate the current date, resulting in an index like services-2024.09.19, you can use the following configuration:

curl http://127.0.0.1:9180/apisix/admin/routes/1 \
-H "X-API-KEY: $admin_key" -X PUT -d '
{
    "plugins":{
        "elasticsearch-logger":{
            "endpoint_addrs":["http://127.0.0.1:9200"],
            "field":{
                "index":"services-${{os.date('%Y.%m.%d')}}"
            }
        }
    },
    "upstream":{
        "type":"roundrobin",
        "nodes":{
            "127.0.0.1:1980":1
        }
    },
    "uri":"/elasticsearch.do"
}'

This configuration uses the os.date function to format the current date and concatenate it with the services string to form the index name. Note that endpoint_addr has been deprecated and replaced with endpoint_addrs ^[1][2][3].

To continue talking to Dosu, mention @dosu.

[myhgc]

@dosu services - ${{os.date('%Y.%m.%d')}} does not work, index not found。is there another way to achieve it ? field.index attribute to include the current date

[dosubot[bot]]

To configure the field.index attribute in the elasticsearch-logger plugin to include the current date, you can use the $time_iso8601 variable provided by APISIX. Here is an example configuration:

curl http://127.0.0.1:9180/apisix/admin/routes/1 \
-H "X-API-KEY: $admin_key" -X PUT -d '
{
    "plugins":{
        "elasticsearch-logger":{
            "endpoint_addrs":["http://127.0.0.1:9200"],
            "field":{
                "index":"services-$time_iso8601",
                "type":"collector"
            },
            "auth":{
                "username":"elastic",
                "password":"123456"
            },
            "ssl_verify":false,
            "timeout": 60,
            "retry_delay":1,
            "buffer_duration":60,
            "max_retry_count":0,
            "batch_max_size":1000,
            "inactive_timeout":5,
            "name":"elasticsearch-logger"
        }
    },
    "upstream":{
        "type":"roundrobin",
        "nodes":{
            "127.0.0.1:1980":1
        }
    },
    "uri":"/elasticsearch.do"
}'

This configuration sets the field.index to services-$time_iso8601, which will include the current date and time in ISO 8601 format. Note that the log_format attribute also supports using APISIX or Nginx variables by prefixing the string with $ ^[1][2].

To continue talking to Dosu, mention @dosu.