Skip to content

Conversation

@prwhelan
Copy link
Member

For spacetime

@prwhelan prwhelan added >non-issue :ml/Transform Transform Team:ML Meta label for the ML team cloud-deploy Publish cloud docker image for Cloud-First-Testing labels Feb 27, 2025
If a user runs with telemetry enabled, a Transform checkpoint shows up
in the APM trace as a collection of discrete API calls.  Eventually,
Transform will open a trace span when it starts a checkpoint and close
a trace span when it finishes a checkpoint. This will unify the discrete
API calls into a single APM trace so the user can see all API calls made
for a given Transform checkpoint.

AsyncTwoPhaseIndexer now has event hooks in place to notify when the
indexer starts a new job and finished a job. Eventually, Transforms
will use this to open/close the trace span.
@prwhelan prwhelan closed this Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cloud-deploy Publish cloud docker image for Cloud-First-Testing :ml/Transform Transform >non-issue Team:ML Meta label for the ML team v9.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants