Skip to content

Conversation

@mathetake
Copy link
Member

@mathetake mathetake commented Oct 17, 2025

Description
This removes one of the test requirement which is Envoy by leveraging func-e via go tool. Since Envoy v1.36 was released, so this also upgrades the envoy version used in the test to v1.36

@codecov-commenter
Copy link

codecov-commenter commented Oct 17, 2025

Codecov Report

❌ Patch coverage is 0% with 25 lines in your changes missing coverage. Please review.
✅ Project coverage is 77.33%. Comparing base (a9b0cd6) to head (9f39c49).

Files with missing lines Patch % Lines
tests/internal/testenvironment/test_environment.go 0.00% 25 Missing ⚠️

❌ Your patch status has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.
❌ Your project status has failed because the head coverage (77.33%) is below the target coverage (86.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1385      +/-   ##
==========================================
- Coverage   77.43%   77.33%   -0.11%     
==========================================
  Files         131      131              
  Lines       16569    16591      +22     
==========================================
  Hits        12831    12831              
- Misses       3101     3123      +22     
  Partials      637      637              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Comment on lines -143 to -145
# Note: we cannot run the latest Envoy version on macOS due to https://github.com/tetratelabs/archive-envoy/issues/12.
# Once it's supported, the following "binary installation" steps below can be just removed and
# we can simply exec.Cmd with "go tool -modfile=tools/go.mod func-e run" with the envoy version configured via ENVOY_VERSION env var.
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we no longer need to test on Envoy latest, which made this PR possible

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also i realized that latest installation had been broken since one-two months ago due to the upstream repo change, so it was useless anyways

@mathetake mathetake force-pushed the lesssetupforcontributors branch from cca8063 to d2dc383 Compare October 18, 2025 00:05
// This always failing backend is configured to have AWS Bedrock schema so that
// we can test that the extproc can fallback to the different schema. E.g. Primary AWS and then OpenAI.
alwaysFailingBackend = filterapi.Backend{Name: "always-failing-backend", Schema: awsBedrockSchema}
alwaysFailingBackend = filterapi.Backend{Name: "always-failing-backend", Schema: openAISchema}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is very hard to explain but this was accidentally working until v1.36 which makes it possible for extproc return the immediate response correctly, so this makes the embedding endpoint test not working: AWS schema doesn't have support for embedding -> try returning immediate response -> previously it was retry-able (due to timeout) vs not retry-able due to extpric immediate response.

In practice, this schema diff retry test case is already covered in the e2e test so no harm

Copy link
Member Author

@mathetake mathetake Oct 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note: This file is what func-e honors as you can see in the help message by go tool -modfile=tools/go.mod func-e help run

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake mathetake force-pushed the lesssetupforcontributors branch from 28139b3 to 9f39c49 Compare October 21, 2025 03:43
@mathetake mathetake marked this pull request as ready for review October 21, 2025 03:48
@mathetake mathetake requested a review from a team as a code owner October 21, 2025 03:48
@mathetake
Copy link
Member Author

ready for YOLO

@mathetake mathetake merged commit dbd6e61 into main Oct 21, 2025
30 checks passed
@mathetake mathetake deleted the lesssetupforcontributors branch October 21, 2025 17:57
AyushSawant18588 pushed a commit to AyushSawant18588/ai-gateway that referenced this pull request Oct 24, 2025
…ts (envoyproxy#1385)

**Description**
This removes one of the test requirement which is Envoy by leveraging
func-e via go tool. Since Envoy v1.36 was released, so this also
upgrades the envoy version used in the test to v1.36

---------

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: ayush <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants