Skip to content

Add source_linked_deployment & git_folder_path to metadata.json#3719

Merged
rclarey merged 7 commits intomainfrom
more-deployment-metadata
Oct 8, 2025
Merged

Add source_linked_deployment & git_folder_path to metadata.json#3719
rclarey merged 7 commits intomainfrom
more-deployment-metadata

Conversation

@rclarey
Copy link
Contributor

@rclarey rclarey commented Oct 3, 2025

Changes

Add two new fields to metadata.json:

  • config.presets.source_linked_deployment
  • extra.git_folder_path

Why

To support Lakeflow integration with DABs

Tests

Added unit tests

@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Oct 3, 2025

Run: 18342088782

Env ✅​pass 🙈​skip 🪲​BUG
🪲​ aws linux 321 541 1
🪲​ aws windows 322 540 1
🪲​ aws-ucws linux 437 437 1
🪲​ aws-ucws windows 438 436 1
🪲​ azure linux 321 540 1
🪲​ azure windows 322 539 1
🪲​ azure-ucws linux 437 436 1
🪲​ azure-ucws windows 438 435 1
🪲​ gcp linux 320 542 1
🪲​ gcp windows 321 541 1
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
TestTelemetryEndpoint 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG 🪲​BUG

@rclarey rclarey temporarily deployed to test-trigger-is October 6, 2025 08:47 — with GitHub Actions Inactive
@rclarey rclarey temporarily deployed to test-trigger-is October 6, 2025 11:49 — with GitHub Actions Inactive
@rclarey rclarey temporarily deployed to test-trigger-is October 7, 2025 09:35 — with GitHub Actions Inactive
}

// Set the git folder path for deployments from the workspace
if b.WorktreeRoot != nil && strings.HasPrefix(b.WorktreeRoot.Native(), "/Workspace/") {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI we already have some of this information captured in the metadata today:

b.Config.Bundle.Git.BundleRootPath = filepath.ToSlash(relBundlePath)

Do we need the absolute git folder path separately? Just curious about the usecase.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes we need to capture the absolute git folder path so we can reconstruct the full path to a resource definition YAML file. e.g. to get the path to a pipeline definition file we combine
GitFolderPath + BundleRootPath + Pipelines[pipelineName].RelativePath

This will be used for breakglass UI where we want to link to where a deployed resource is defined in its DAB

@rclarey rclarey temporarily deployed to test-trigger-is October 7, 2025 11:57 — with GitHub Actions Inactive
@rclarey rclarey temporarily deployed to test-trigger-is October 7, 2025 11:57 — with GitHub Actions Inactive
@rclarey rclarey changed the title Add source_linked & git_folder_path to metadata.json Add source_linked_deployment & git_folder_path to metadata.json Oct 7, 2025
@rclarey rclarey temporarily deployed to test-trigger-is October 8, 2025 09:01 — with GitHub Actions Inactive
@rclarey rclarey temporarily deployed to test-trigger-is October 8, 2025 09:48 — with GitHub Actions Inactive
@rclarey rclarey force-pushed the more-deployment-metadata branch from 464d2f2 to cd87e8a Compare October 8, 2025 10:43
@rclarey rclarey temporarily deployed to test-trigger-is October 8, 2025 10:43 — with GitHub Actions Inactive
@rclarey rclarey added this pull request to the merge queue Oct 8, 2025
Merged via the queue into main with commit dfa9454 Oct 8, 2025
13 checks passed
@rclarey rclarey deleted the more-deployment-metadata branch October 8, 2025 11:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

Comments