Multiline rule example #4520

lyoshakarpenko · 2021-12-23T08:00:55Z

lyoshakarpenko
Dec 23, 2021

Hi, I am planning to collect logs from my production kubernetes cluster. In my case, multiline logs can be not only a stack trace. I wrote such rules for a multiline parser. In the second case, I wrote the negation of the first condition. What I think is not true. Please show how to correctly describe all possible options, the syntax of the parser is of interest.

[MULTILINE_PARSER]
        name          multiline-regex
        type          regex
        #
        # Regex rules for multiline parsing
        # ---------------------------------
        #
        # configuration hints:
        #
        #  - first state always has the name: start_state
        #  - every field in the rule must be inside double quotes
        #
        # rules |   state name  | regex pattern                  | next state
        # ------|---------------|--------------------------------------------
        rule      "start_state"   "/^((\d{4}-\d{2}-\d{2})\s\d+\:\d+\:\d+.\d+\s\+\d+\:\d+).*$/"  "cont"
        rule      "cont"          "/^(?!(\d{4}-\d{2}-\d{2})\s\d+\:\d+\:\d+.\d+\s\+\d+\:\d+).*$/"   "cont"

Log examples:

2021-12-15 10:10:22.993 +00:00 [ERR] [Microsoft.AspNetCore.Diagnostics.ExceptionHandlerMiddleware] An unhandled exception has occurred while executing the request.
FreeFloating.Domain.DomainException: MustBeWithinParkingToChangeLockStatus: { Key = 134 }
   at FreeFloating.Services.Business.Commands.LockVehicleDoorsCommand.Run(Vehicle vehicle) in /src/services/app/FreeFloating.Services.Business/Commands/Vehicle/LockUnlock.cs:line 28
   at FreeFloating.Services.Api.Client.TripController.LockVehicleDoors(ActiveTripVehicleQuery activeTripVehicleQuery, LockVehicleDoorsCommand lockDoors) in /src/services/app/FreeFloating.Services.Api/Client/TripController.cs:line 110
   at lambda_method2344(Closure , Object )
   at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Logged|12_1(ControllerActionInvoker invoker)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|19_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
   at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker)
   at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
   at Confifu.AspNetCore.Builder.AspNetCoreConfigurationFactory.<>c__DisplayClass6_1.<<SetupChildMiddleware>b__2>d.MoveNext()
--- End of stack trace from previous location ---
   at Confifu.AspNetCore.Builder.AspNetCoreConfigurationFactory.<>c__DisplayClass6_1.<<SetupChildMiddleware>b__2>d.MoveNext()
--- End of stack trace from previous location ---
   at Microsoft.AspNetCore.Diagnostics.ExceptionHandlerMiddleware.<Invoke>g__Awaited|6_0(ExceptionHandlerMiddleware middleware, HttpContext context, Task task)

2021-12-17 08:55:11.037 +00:00 [ERR] [Services.Business.Services.DriverLicenseService] Failed to request DLS. CorellationID: 5f42a7a1405d47498df1b353555b91ae
HTTP Response:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
<HTML><HEAD><TITLE>Service Unavailable</TITLE>
<META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
<BODY><h2>Service Unavailable</h2>
<hr><p>HTTP Error 503. The service is unavailable.</p>
</BODY></HTML>

Fria.DlsService.SwaggerException: The HTTP status code of the response was not expected (503).
Status: 503

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Multiline rule example #4520

Uh oh!

{{title}}

Uh oh!

Replies: 0 comments

Select a reply

Uh oh!

Multiline rule example #4520

Uh oh!

lyoshakarpenko Dec 23, 2021

Replies: 0 comments

lyoshakarpenko
Dec 23, 2021