[JENKINS-64383] combined refrepo became our bottleneck, support a fanout location too#644

Open

jimklimov wants to merge 160 commits intojenkinsci:masterfrom

jimklimov:refrepo-args

Commits on Jan 10, 2021

Introduce support for reference repository paths ending with /${GIT_URL} to replace by url => funny dir subtree in filesystem
jimklimov
committed
Refactor: move findParameterizedReferenceRepository() into LegacyCompatibleGitAPIImpl.java so its logic (expected to grow in complexity) can be shared by both JGitAPIImpl.java and CliGitAPIImpl.java
jimklimov
committed
Add isParameterizedReferenceRepository() and support for parameterized ref-repos in submodule checkouts (only CliGitAPIImpl.java has it)
jimklimov
committed
Handle the possibility that the URL for parameterized checkout is null String
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: document params for new routines
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: refactor urlNormalized generation in findParameterizedReferenceRepository()
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: introduce support for .../${GIT_URL_SHA256} reference repos
jimklimov
committed
WorkspaceWithRepo.java (test): extend localMirror() with customizable name for the mirrored repo
jimklimov
committed
GitClientCloneTest.java: add test_clone_reference_parameterized_sha256() with real sanity checks
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: findParameterizedReferenceRepository(): do not bother normalizing the URL if the string is not with supported suffix
jimklimov
committed
Fix referencePath getName() => getPath()
jimklimov
committed
Update tests for fRefrepoBase being under target/ dir from CWD of the test runner
jimklimov
committed
GitClientCloneTest: check if refrepo dir exists already
jimklimov
committed
WorkspaceWithRepo.java: localMirror(): normalize() the returned pathname string
jimklimov
committed
GitClientCloneTest.java: extend API choices for assertAlternateFilePointsToLocal*Mirror() with custom paths and bare vs workspace repos
jimklimov
committed
GitClientCloneTest.java: fix test_clone_reference_parameterized_sha256() to find expected paths
jimklimov
committed
LegacyCompatibleGitAPIImpl.java CliGitAPIImpl.java JGitAPIImpl.java: refactor getObjectPath(referencePath) to check on git dirs elsewhere later
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: add variants of findParameterizedReferenceRepository() and isParameterizedReferenceRepository() taking a File reference (not only a String) object
jimklimov
committed
[TMP] LegacyCompatibleGitAPIImpl.java: trace findParameterizedReferenceRepository() processing to stderr
jimklimov
committed
[TMP] WorkspaceWithRepo.java (test): trace localMirror() processing to stderr
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: refactor to use referenceExpanded to keep original reference intact, and as indicator to recreate referencePath object once for many cases
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: add GIT_URL_FALLBACK and GIT_URL_SHA256_FALLBACK suffixes for using unsuffixed directory if expanded path points nowhere useful
jimklimov
committed
GitClientCloneTest.java: add cases for parameterized reference repo with fallback modes of operation
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: refactor normalizeGitUrl()
jimklimov
committed
[WIP] LegacyCompatibleGitAPIImpl.java: skeleton for GIT_SUBMODULES and GIT_SUBMODULES_FALLBACK support
jimklimov
committed
Introduce getRemoteUrls() and getRemotePushUrls()
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: normalizeGitUrl(): revise for local path names
jimklimov
committed
[WIP] LegacyCompatibleGitAPIImpl.java: skeleton for GIT_SUBMODULES and GIT_SUBMODULES_FALLBACK support
jimklimov
committed
CliGitAPIImpl.java: extend getRemote{,Push}Urls() with filters for ACSII and for "safe" URLs without username/password, to match jGit version
jimklimov
committed
GitClientCloneTest.java: if we expect particular wsRefrepo spelling, note it in assertion stacktrace
jimklimov
committed
GitClientCloneTest.java: for fallback case, expect wsRefrepoBase itself
jimklimov
committed
GitClientCloneTest.java: use the LegacyCompatibleGitAPIImpl.normalizeGitUrl() directly
jimklimov
committed
GitClientCloneTest.java: for fallback case, expect wsRefrepoBase itself (might have or not the SHA dir after it)
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: skeleton for getSubmodulesUrls() as needed for GIT_SUBMODULES
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: update comments for ideas about submodule searches
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: getSubmodulesUrls(): implement the search for "needle" in bare repo case
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: move arrDirNames declaration higher in scope
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: update commented thoughts
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: prepare to parse submodule workspaces
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: uncomment needle tracking in a loop that we might not-abort after all
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: fix @param usage
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: implement handling output of getSubmodulesUrls() in findParameterizedReferenceRepository()
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: getSubmodulesUrls() / findParameterizedReferenceRepository(): deal with LinkedHashSet instead of plain Set to maintain insertion order as the priority
jimklimov
committed
LegacyCompatibleGitAPIImpl.java: findParameterizedReferenceRepository(): comment a TODO in case there are several hits in the getSubmodulesUrls() return
jimklimov
committed

Commits on Jan 11, 2021

Commits on Jan 12, 2021

Commits on Jan 13, 2021

LegacyCompatibleGitAPIImpl.java: update comments around shorter getSubmodulesUrls() signature
jimklimov
committed

Commits on Jan 14, 2021

Commits on Jan 16, 2021

Commits on Jan 17, 2021

Commits on Jan 18, 2021

Commits on Jan 31, 2021

Commits on Feb 22, 2021

Commits on Jan 27, 2022

Commits on Aug 1, 2022

Commits on Aug 10, 2022

Commits on Sep 5, 2022

Merge branch 'master' into refrepo-args
MarkEWaite
committed

Commits on Sep 14, 2022

Merge branch 'master' into refrepo-args
MarkEWaite
committed

Commits on Dec 21, 2022

Merge branch 'master' into refrepo-args
jimklimov
authored

Commits on Jun 14, 2023

Commits on Jan 17, 2024

Merge branch 'master' into refrepo-args
MarkEWaite
committed

Commits on Mar 9, 2024

Merge branch 'master' into refrepo-args
MarkEWaite
committed

Commits on Jun 14, 2024

Merge remote-tracking branch 'upstream/master' into refrepo-args
jimklimov
committed

Commits on Oct 31, 2024

Merge remote-tracking branch 'upstream/master' as of 2024-10-31 into refrepo-args
jimklimov
committed

Commits on Jan 16, 2025

Merge remote-tracking branch 'upstream/master' as of 2025-01-16 into refrepo-args
jimklimov
committed

Commits on Jan 21, 2025

Merge remote-tracking branch 'upstream/master' into refrepo-args
jimklimov
committed

Commits on Feb 22, 2025

Merge remote-tracking branch 'upstream/master' into refrepo-args
jimklimov
committed

Commits on Mar 22, 2025

Merge remote-tracking branch 'upstream/master' into refrepo-args
jimklimov
committed

Commits on Jun 23, 2025

Commits on Aug 4, 2025

Merge remote-tracking branch 'upstream/master' after v6.3.0 into refrepo-args
jimklimov
committed

Commits on Sep 2, 2025

Merge remote-tracking branch 'upstream/master' after v6.3.2 into refrepo-args
jimklimov
committed

Commits on Sep 16, 2025

Commits on Sep 17, 2025

GitClientCloneTest: fix style complaints with `mvn spotless:apply`
jimklimov
committed