Skip to content

Use Apache closer.lua syntax for kyuubi-download to obtain engine archives#7205

Closed
pan3793 wants to merge 1 commit intoapache:masterfrom
pan3793:closer-lua
Closed

Use Apache closer.lua syntax for kyuubi-download to obtain engine archives#7205
pan3793 wants to merge 1 commit intoapache:masterfrom
pan3793:closer-lua

Conversation

@pan3793
Copy link
Member

@pan3793 pan3793 commented Sep 12, 2025

Why are the changes needed?

Speed up download Spark, Flink, and Hive tarballs, for the latest versions.

https://infra.apache.org/release-download-pages.html#download-scripts

How was this patch tested?

Observe GHA.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added kind:documentation Documentation is a feature! kind:infra license, community building, project builds, asf infra related, etc. kind:build labels Sep 12, 2025
@codecov-commenter
Copy link

codecov-commenter commented Sep 12, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 0.00%. Comparing base (2431435) to head (10ffa34).
⚠️ Report is 6 commits behind head on master.

Additional details and impacted files
@@          Coverage Diff           @@
##           master   #7205   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         695     695           
  Lines       43479   43479           
  Branches     5882    5882           
======================================
  Misses      43479   43479           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@Marvel-Gu
Copy link

I have some concerns, some older versions seem to be unavailable from https://www.apache.org/dyn/closer.lua
image
@pan3793 @cxzl25 @bowenliang123

@pan3793
Copy link
Member Author

pan3793 commented Sep 22, 2025

@Marvel-Gu please try the URL with query part ?action=download

@pan3793
Copy link
Member Author

pan3793 commented Sep 22, 2025

This is not an ideal solution.

It would be great if someone were interested in writing a GitHub Actions, like actions/setup-java, then we can leverage the super-fast cache provided by GitHub Actions to speed up the installation of other Apache software binaries. I think this will benefit a lot of projects.

@pan3793 pan3793 self-assigned this Sep 22, 2025
@pan3793 pan3793 added this to the v1.10.3 milestone Sep 22, 2025
@pan3793 pan3793 closed this in 28bba27 Sep 22, 2025
pan3793 added a commit that referenced this pull request Sep 22, 2025
…tain engine archives

Speed up download Spark, Flink, and Hive tarballs, for the latest versions.

https://infra.apache.org/release-download-pages.html#download-scripts

Observe GHA.

No.

Closes #7205 from pan3793/closer-lua.

Closes #7205

10ffa34 [Cheng Pan] Use Apache closer.lua syntax for kyuubi-download to obtain engine archives

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>
(cherry picked from commit 28bba27)
Signed-off-by: Cheng Pan <chengpan@apache.org>
@pan3793
Copy link
Member Author

pan3793 commented Sep 22, 2025

Merged to master/1.10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind:build kind:documentation Documentation is a feature! kind:infra license, community building, project builds, asf infra related, etc.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants