Accounting Service drops "duplicate key value violates"

[svrnm]

Bug Report

I was running the otel demo for a longer time and at some point the accounting service started to drop duplicate key value violates

Reproduce

I am still investigating why this is happening but my feeling is that this happens by running the service for a long time ("hours").

Additional Context

Log Entry

│ info: Accounting.Consumer[174880625]                                                                                                                                                                                                                                                                             │
│       Order details: { "orderId": "5fbce811-cf5a-11f0-8ab4-d61ef845fff7", "shippingTrackingId": "ea236d83-469e-42fd-b205-2303aeedcc96", "shippingCost": { "currencyCode": "USD", "units": "231" }, "shippingAddress": { "streetAddress": "100 Winchester Circle", "city": "Los Gatos", "state": "CA", "country": │
│  "United States", "zipCode": "95032" }, "items": [ { "item": { "productId": "2ZYFJ3GM2N", "quantity": 5 }, "cost": { "currencyCode": "USD", "units": "209", "nanos": 949999999 } } ] }.                                                                                                                          │
│ fail: Accounting.Consumer[0]                                                                                                                                                                                                                                                                                     │
│       Order parsing failed:                                                                                                                                                                                                                                                                                      │
│       Microsoft.EntityFrameworkCore.DbUpdateException: An error occurred while saving the entity changes. See the inner exception for details.                                                                                                                                                                   │
│        ---> Npgsql.PostgresException (0x80004005): 23505: duplicate key value violates unique constraint "order_pkey"                                                                                                                                                                                            │
│                                                                                                                                                                                                                                                                                                                  │
│       DETAIL: Detail redacted as it may contain sensitive data. Specify 'Include Error Detail' in the connection string to include this information.                                                                                                                                                             │
│          at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)                                                                                                                               │
│          at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)                                                                                                                               │
│          at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)                                                                                                                                                                                          │
│          at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)                                                                                                                                                                                          │
│          at Npgsql.NpgsqlDataReader.NextResult()                                                                                                                                                                                                                                                                 │
│          at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)                                                                                                                                                                                     │
│          at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)                                                                                                                                                                                     │
│          at Npgsql.NpgsqlCommand.ExecuteReader(CommandBehavior behavior)                                                                                                                                                                                                                                         │
│          at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior)                                                                                                                                                                                                                                   │
│          at System.Data.Common.DbCommand.ExecuteReader()                                                                                                                                                                                                                                                         │
│          at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReader(RelationalCommandParameterObject parameterObject)                                                                                                                                                                              │
│          at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.Execute(IRelationalConnection connection)                                                                                                                                                                                        │
│         Exception data:                                                                                                                                                                                                                                                                                          │
│           Severity: ERROR                                                                                                                                                                                                                                                                                        │
│           SqlState: 23505                                                                                                                                                                                                                                                                                        │
│           MessageText: duplicate key value violates unique constraint "order_pkey"                                                                                                                                                                                                                               │
│           Detail: Detail redacted as it may contain sensitive data. Specify 'Include Error Detail' in the connection string to include this information.                                                                                                                                                         │
│           SchemaName: public                                                                                                                                                                                                                                                                                     │
│           TableName: order                                                                                                                                                                                                                                                                                       │
│           ConstraintName: order_pkey                                                                                                                                                                                                                                                                             │
│           File: nbtinsert.c                                                                                                                                                                                                                                                                                      │
│           Line: 666                                                                                                                                                                                                                                                                                              │
│           Routine: _bt_check_unique                                                                                                                                                                                                                                                                              │
│          --- End of inner exception stack trace ---                                                                                                                                                                                                                                                              │
│          at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.Execute(IRelationalConnection connection)                                                                                                                                                                                        │
│          at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.Execute(IEnumerable`1 commandBatches, IRelationalConnection connection)                                                                                                                                                                  │
│          at Microsoft.EntityFrameworkCore.Storage.RelationalDatabase.SaveChanges(IList`1 entries)                                                                                                                                                                                                                │
│          at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChanges(IList`1 entriesToSave)                                                                                                                                                                                                │
│          at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChanges(StateManager stateManager, Boolean acceptAllChangesOnSuccess)                                                                                                                                                         │
│          at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.<>c.<SaveChanges>b__112_0(DbContext _, ValueTuple`2 t)                                                                                                                                                                            │
│          at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.Execute[TState,TResult](TState state, Func`3 operation, Func`3 verifySucceeded)                                                                                                                                       │
│          at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChanges(Boolean acceptAllChangesOnSuccess)                                                                                                                                                                                    │
│          at Microsoft.EntityFrameworkCore.DbContext.SaveChanges(Boolean acceptAllChangesOnSuccess)                                                                                                                                                                                                               │
│          at Microsoft.EntityFrameworkCore.DbContext.SaveChanges()                                                                                                                                                                                                                                                │
│          at Accounting.Consumer.ProcessMessage(Message`2 message) in /src/Accounting/Consumer.cs:line 125                                                                                                                                                                                                        │
│ info: Accounting.Consumer[174880625]                                                                                                                                                                                                                                                                             │
│       Order details: { "orderId": "602832be-cf5a-11f0-8ab4-d61ef845fff7", "shippingTrackingId": "10830fa5-87ae-4563-a897-dd45c1d53952", "shippingCost": { "currencyCode": "CAD", "units": "128", "nanos": 464219371 }, "shippingAddress": { "streetAddress": "150 Elgin St", "city": "Ottawa", "state": "ON", "c │
│ ountry": "Canada", "zipCode": "K2P1L4" }, "items": [ { "item": { "productId": "1YMWWN1N4O", "quantity": 1 }, "cost": { "currencyCode": "CAD", "units": "173", "nanos": 895055285 } } ] }.

[julianocosta89]

I can see that as well!
I have the Demo running for 13 days, got a couple of errors 😅 :

The db.statement span attribute seems weird:

INSERT INTO "order" (order_id)
VALUES (@p0);
INSERT INTO "order" (order_id)
VALUES (@p1);
INSERT INTO "order" (order_id)
VALUES (@p2);
INSERT INTO "order" (order_id)
VALUES (@p3);
INSERT INTO "order" (order_id)
VALUES (@p4);
INSERT INTO "order" (order_id)
VALUES (@p5);
INSERT INTO "order" (order_id)
VALUES (@p6);
INSERT INTO "order" (order_id)
VALUES (@p7);
INSERT INTO "order" (order_id)
VALUES (@p8);
INSERT INTO "order" (order_id)
VALUES (@p9);
INSERT INTO "order" (order_id)
VALUES (@p10);
INSERT INTO "order" (order_id)
VALUES (@p11);
INSERT INTO "order" (order_id)
VALUES (@p12);
INSERT INTO "order" (order_id)
VALUES (@p13);
INSERT INTO "order" (order_id)
VALUES (@p14);
INSERT INTO "order" (order_id)
VALUES (@p15);
INSERT INTO "order" (order_id)
VALUES (@p16);
INSERT INTO "order" (order_id)
VALUES (@p17);
INSERT INTO "order" (order_id)
VALUES (@p18);
INSERT INTO "order" (order_id)
VALUES (@p19);
INSERT INTO "order" (order_id)
VALUES (@p20);
INSERT INTO "order" (order_id)
VALUES (@p21);
INSERT INTO "order" (order_id)
VALUES (@p22);
INSERT INTO "order" (order_id)
VALUES (@p23);
INSERT INTO "order" (order_id)
VALUES (@p24);
INSERT INTO "order" (order_id)
VALUES (@p25);
INSERT INTO "order" (order_id)
VALUES (@p26);
INSERT INTO "order" (order_id)
VALUES (@p27);
INSERT INTO "order" (order_id)
VALUES (@p28);
INSERT INTO "order" (order_id)
VALUES (@p29);
INSERT INTO "order" (order_id)
VALUES (@p30);
INSERT INTO "order" (order_id)
VALUES (@p31);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p32, @p33, @p34, @p35, @p36, @p37);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p38, @p39, @p40, @p41, @p42, @p43);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p44, @p45, @p46, @p47, @p48, @p49);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p50, @p51, @p52, @p53, @p54, @p55);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p56, @p57, @p58, @p59, @p60, @p61);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p62, @p63, @p64, @p65, @p66, @p67);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p68, @p69, @p70, @p71, @p72, @p73);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p74, @p75, @p76, @p77, @p78, @p79);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p80, @p81, @p82, @p83, @p84, @p85);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p86, @p87, @p88, @p89, @p90, @p91);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p92, @p93, @p94, @p95, @p96, @p97);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p98, @p99, @p100, @p101, @p102, @p103);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p104, @p105, @p106, @p107, @p108, @p109);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p110, @p111, @p112, @p113, @p114, @p115);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p116, @p117, @p118, @p119, @p120, @p121);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p122, @p123, @p124, @p125, @p126, @p127);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p128, @p129, @p130, @p131, @p132, @p133);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p134, @p135, @p136, @p137, @p138, @p139);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p140, @p141, @p142, @p143, @p144, @p145);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p146, @p147, @p148, @p149, @p150, @p151);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p152, @p153, @p154, @p155, @p156, @p157);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p158, @p159, @p160, @p161, @p162, @p163);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p164, @p165, @p166, @p167, @p168, @p169);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p170, @p171, @p172, @p173, @p174, @p175);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p176, @p177, @p178, @p179, @p180, @p181);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p182, @p183, @p184, @p185, @p186, @p187);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p188, @p189, @p190, @p191, @p192, @p193);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p194, @p195, @p196, @p197, @p198, @p199);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p200, @p201, @p202, @p203, @p204, @p205);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p206, @p207, @p208, @p209, @p210, @p211);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p212, @p213, @p214, @p215, @p216, @p217);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p218, @p219, @p220, @p221, @p222, @p223);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p224, @p225, @p226, @p227, @p228, @p229);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p230, @p231, @p232, @p233, @p234, @p235);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p236, @p237, @p238, @p239, @p240, @p241);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p242, @p243, @p244, @p245, @p246, @p247);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p248, @p249, @p250, @p251, @p252, @p253);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p254, @p255, @p256, @p257, @p258, @p259);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p260, @p261, @p262, @p263, @p264, @p265);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p266, @p267, @p268, @p269, @p270, @p271);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p272, @p273, @p274, @p275, @p276, @p277);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p278, @p279, @p280, @p281, @p282, @p283);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p284, @p285, @p286, @p287, @p288, @p289);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p290, @p291, @p292, @p293, @p294, @p295);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p296, @p297, @p298, @p299, @p300, @p301);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p302, @p303, @p304, @p305, @p306, @p307);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p308, @p309, @p310, @p311, @p312, @p313);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p314, @p315, @p316, @p317, @p318, @p319);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p320, @p321, @p322, @p323, @p324, @p325);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p326, @p327, @p328, @p329, @p330, @p331);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p332, @p333, @p334, @p335, @p336, @p337);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p338, @p339, @p340, @p341, @p342, @p343);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p344, @p345, @p346, @p347, @p348, @p349);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p350, @p351, @p352, @p353, @p354, @p355);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p356, @p357, @p358, @p359, @p360, @p361);
INSERT INTO orderitem (order_id, product_id, item_cost_currency_code, item_cost_nanos, item_cost_units, quantity)
VALUES (@p362, @p363, @p364, @p365, @p366, @p367);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p368, @p369, @p370, @p371, @p372, @p373, @p374, @p375, @p376, @p377);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p378, @p379, @p380, @p381, @p382, @p383, @p384, @p385, @p386, @p387);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p388, @p389, @p390, @p391, @p392, @p393, @p394, @p395, @p396, @p397);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p398, @p399, @p400, @p401, @p402, @p403, @p404, @p405, @p406, @p407);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p408, @p409, @p410, @p411, @p412, @p413, @p414, @p415, @p416, @p417);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p418, @p419, @p420, @p421, @p422, @p423, @p424, @p425, @p426, @p427);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p428, @p429, @p430, @p431, @p432, @p433, @p434, @p435, @p436, @p437);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p438, @p439, @p440, @p441, @p442, @p443, @p444, @p445, @p446, @p447);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p448, @p449, @p450, @p451, @p452, @p453, @p454, @p455, @p456, @p457);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p458, @p459, @p460, @p461, @p462, @p463, @p464, @p465, @p466, @p467);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p468, @p469, @p470, @p471, @p472, @p473, @p474, @p475, @p476, @p477);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p478, @p479, @p480, @p481, @p482, @p483, @p484, @p485, @p486, @p487);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p488, @p489, @p490, @p491, @p492, @p493, @p494, @p495, @p496, @p497);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p498, @p499, @p500, @p501, @p502, @p503, @p504, @p505, @p506, @p507);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p508, @p509, @p510, @p511, @p512, @p513, @p514, @p515, @p516, @p517);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p518, @p519, @p520, @p521, @p522, @p523, @p524, @p525, @p526, @p527);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p528, @p529, @p530, @p531, @p532, @p533, @p534, @p535, @p536, @p537);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p538, @p539, @p540, @p541, @p542, @p543, @p544, @p545, @p546, @p547);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p548, @p549, @p550, @p551, @p552, @p553, @p554, @p555, @p556, @p557);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p558, @p559, @p560, @p561, @p562, @p563, @p564, @p565, @p566, @p567);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p568, @p569, @p570, @p571, @p572, @p573, @p574, @p575, @p576, @p577);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p578, @p579, @p580, @p581, @p582, @p583, @p584, @p585, @p586, @p587);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p588, @p589, @p590, @p591, @p592, @p593, @p594, @p595, @p596, @p597);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p598, @p599, @p600, @p601, @p602, @p603, @p604, @p605, @p606, @p607);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p608, @p609, @p610, @p611, @p612, @p613, @p614, @p615, @p616, @p617);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p618, @p619, @p620, @p621, @p622, @p623, @p624, @p625, @p626, @p627);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p628, @p629, @p630, @p631, @p632, @p633, @p634, @p635, @p636, @p637);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p638, @p639, @p640, @p641, @p642, @p643, @p644, @p645, @p646, @p647);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p648, @p649, @p650, @p651, @p652, @p653, @p654, @p655, @p656, @p657);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p658, @p659, @p660, @p661, @p662, @p663, @p664, @p665, @p666, @p667);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p668, @p669, @p670, @p671, @p672, @p673, @p674, @p675, @p676, @p677);
INSERT INTO shipping (shipping_tracking_id, city, country, order_id, shipping_cost_currency_code, shipping_cost_nanos, shipping_cost_units, state, street_address, zip_code)
VALUES (@p678, @p679, @p680, @p681, @p682, @p683, @p684, @p685, @p686, @p687);

The log message is Order parsing failed:, which is raised from here:

opentelemetry-demo/src/accounting/Consumer.cs

Line 86 in af06b00

private void ProcessMessage(Message<string, byte[]> message)