Feature/add etag validation

[dhee-tree]

What

Add etag validation to version updates in download tasks

How to review

• Run branch with migration stack
• use Zebedee branch in the PR
• Start a migration job
• Monitor the docker logs
• To trigger a conflict
  • Add this delay in L#203 (gives you some time to change the version - fastest fingers first)

    log.Info(ctx, "Edit this dataset version to trigger ETag conflict", log.Data{
    	"task_id":       task.ID,
    	"dataset_id":    task.Target.DatasetID,
    	"edition_id":    task.Target.EditionID,
    	"version_id":    task.Target.VersionID,
    	"fetched_e_tag": respHeaders.ETag,
    	"delay":         "30s",
    })
    time.Sleep(30 * time.Second)

  • Change the version before job does PutVersion. Best way is to send a PUT req to the dataset API to update the version i.e. update version 1
  • PUT req to

   http://localhost:22000/datasets/new-dataset/editions/latestversion/versions/1

  • body

  {
   "edition_title": "Updated Latest version",
   "version": 1,
   "type": "static"
  }

  • Inspect logs for conflict and attempt to resolve
    • If you missed it reset the database with the very handy make reset, start a job and send the PUT again
  • You should get similar log

   {
  "created_at": "2026-02-12T13:49:37.714566931Z",
  "data": {
    "attempt": 1,
    "delay": "92.14648ms",
    "task_id": "3a0841ef-5fd8-4dfa-97e4-c311ff801eff"
  },
  "event": "ETag conflict, retrying after delay",
  "namespace": "dis-migration-service",
  "severity": 3
   }

• Job state should be in_review

Who can review

!Me