Skip to content

Conversation

Robin-Van-de-Merghel
Copy link
Contributor

BEGINRELEASENOTES

*PilotManagerHandler
NEW: POC base on #8233 to manage pilots, and allow legacy pilots to send logs.

ENDRELEASENOTES

@Robin-Van-de-Merghel
Copy link
Contributor Author

Context

DIRAC pilot: Pilot sent by DIRAC with a proxy without a DiracX token embedded in it

Legacy pilot: Pilot sent by DIRAC with a proxy with a DiracX token embedded in it

DiracX pilot: Pilot sent by DiracX with a secret to exchange for a DiracX token

Feature

Connected to:

  1. [POC] Pilot legacy logging diracx#596 for DiracX backend supporting pilot management, and legacy logging
  2. feat: Add pilot pilot logging (legacy and DiracX) Pilot#260 to contact DiracX directly to send logs from a proxy (+ later with a secret)

We can have a legacy pilot:

  1. Extracting a DiracX token from its proxy (showed by every integration test)
  2. Sending logs to DiracX
  3. Refreshing its tokens because it's an user token with a short lifespan

[3b20343] fix: Fixed ClientSelector to raise an error if the CS is badly configured
[4b715ef] fix: Fixed doc, and went back on the client selector
[ff736bb] docs: Add documentation to start the integration tests.
[7107442] feat: Add legacy adaptor in CI
[7ae3428] fix: Fixed to support better other branches
[2066814] feat: Add diracx repo choice in the integration test
[7859c6b] fix: Use JobStateUpdateClient instead of deactivating it
[e3b1d68] fix: Resolved dirac-proxy-init issue with multi-VO
[d2f99c0] fix: Resolved bug for setJobAttributes
[fe09e19] fix: Fixed ClientWMS test and reversed TEST_DIRACX flag
[1447a20] fix: Use opensearch db for job parametersDB
[f6116aa] fix: Made mariadb works better
[c4ab3f2] fix: Fixed CI to use sandoxes
[a5a02bc] fix: Activate job endpoints in CI
[a1bc1b1] fix: Applied changes to the ci workflows
[282efcb] refactor: Moved down diracx installation to fix auth
[ac22d9d] feat: Add DiracX tests into DIRAC CI, and use only latest tag.
[0ebf454] fix: Moved up futureServices argument to prevent "Missing mandatory /DiracX/URL configuration"
[d98b705] fix: Fixed small bug and refactored ClientSelector
[8ce234c] fix: Small fixes with docker compose cmd and removed grep
[08d9eb1] fix: Add filters to remove 'Client' from  services name
[bc44891] fix: Remove error when a future client is not available to warn instead
[a1f553d] fix: Changed to make the legacy adaptor automatic.
[3fb8c4d] fix: Fixed destroy command to support MacOSX
[42df58d] fix: Going back, removed CI, and going to add it to DiracX
[28b9789] fix: Small fix (forgot to change to docker**compose)
[61384af] feat: Add in CI new legacy adapted services.
[a3a7f5b] feat: Add legacy adaptor in CI
@Robin-Van-de-Merghel Robin-Van-de-Merghel force-pushed the robin-pilot-legacy-logging branch from c3902f8 to 5fd7250 Compare August 1, 2025 06:49
@Robin-Van-de-Merghel Robin-Van-de-Merghel force-pushed the robin-pilot-legacy-logging branch from 5fd7250 to da1ee40 Compare August 1, 2025 07:13
@Robin-Van-de-Merghel
Copy link
Contributor Author

Important

This PR is not usable in prod as of now.

Pilots DO NOT have tokens in their proxies, so we cannot extract their token from it. DIRACGrid/Pilot#260 is only working as in the CI, pilot proxies are generate via a dirac-proxy-init which embed a DiracX token.

In the SiteDirector, there's no such thing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant