Improve support for custom OpenSSL selection

[masa-koz]

Description

This pull request introduces improved support for building with an external OpenSSL installation, primarily by adding a new openssl_external feature and enhancing the build system to handle more flexible OpenSSL configuration. The changes affect CMake configuration, Rust feature flags, and build scripts to better support both static and shared linking, and to allow specifying OpenSSL paths via environment variables.

Build system and CMake improvements:

• Added a new CMake cache variable QUIC_OPENSSL_ROOT_DIR to allow specifying the OpenSSL root directory, and updated OpenSSL selection logic to support this variable for both static and shared builds. [1] [2]
• Enhanced the CMake logic to properly select between static and shared OpenSSL libraries based on the BUILD_SHARED_LIBS flag, and improved handling of imported OpenSSL targets to avoid duplicate dependency linking.

Rust feature and build script updates:

• Introduced a new Cargo feature openssl_external for building with an external OpenSSL, and updated the build script (scripts/build.rs) to configure CMake accordingly by passing the appropriate variables from environment variables if set. [1] [2]
• Adjusted the output directory logic in the build script to use lib on Windows and artifacts elsewhere, improving compatibility with different platforms.

Test and platform compatibility:

• Updated test logic in src/rs/config.rs to recognize the new openssl_external feature when determining which TLS provider is active on Windows.

Testing

No

Documentation

TBD

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 84.89%. Comparing base (45a46f3) to head (807eadc).

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #5848      +/-   ##
==========================================
- Coverage   86.30%   84.89%   -1.41%     
==========================================
  Files          60       60              
  Lines       18732    18732              
==========================================
- Hits        16167    15903     -264     
- Misses       2565     2829     +264     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.