Skip to content

Summarizer can fail on getting write_validated_must_get_agent_activity_chain_len after scenario doesn't produce any values for that metric #431

@ThetaSinner

Description

@ThetaSinner

https://github.com/holochain/wind-tunnel/actions/runs/20378593827/job/58568194485?pr=429

The summarizer fails with the following output:

[2025-12-19T19:23:36Z DEBUG holochain_summariser::query] Querying: ReadQuery { queries: ["SELECT value, zome_name, fn_name FROM \"windtunnel\".\"autogen\".\"wt.instruments.operation_duration\" WHERE run_id = 'zero_arc_create_and_read_20378593827' AND (operation_id = 'app_call_zome' OR operation_id = 'trycp_app_call_zome') AND is_error = 'true'"] }
Error: 1 out of 19 summaries failed:
[
    Error {
        context: "Write validated must_get_agent_activity summary",
        source: Error {
            context: "Load write_validated_must_get_agent_activity_chain_len data",
            source: NoSeriesInResult {
                table: "wt.custom.write_validated_must_get_agent_activity_chain_len",
                result: Object {
                    "statement_id": Number(0),
                },
            },
        },
    },
]

The question then is why no values were produced for that metric. It suggests that no must_get_agent_activity calls succeeded during the time that the scenario was running.

It is valid for the summarizer to report the issue. However, it's unhelpful to have the scenario not appear stable on CI. The suggestion for this issue is a brief assessment of the scenario:

  • Do the setup and agent setup hooks properly prepare the scenario to do useful work?
  • Does the scenario need more run time on CI than it is given in order to reliably start doing useful work?
  • Are there any obvious issues with how the metric in question is reported that could have led to the failure?

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions