Skip to content

Conversation

ScrewTSW
Copy link
Member

What does this PR do?

  • Adds new approach to running tests based on ai.json
  • Fixes model download timeouts inconsistency

Screenshot / video of UI

What issues does this PR fix or reference?

Closes #3333

How to test this PR?

@ScrewTSW ScrewTSW requested review from benoitf, jeffmaury and a team as code owners July 30, 2025 13:42
@ScrewTSW ScrewTSW changed the title 3333 tests based on ai json poc Switch test run to ai-json parsed set of applications Jul 30, 2025
});
});
// Create a set of AI models that are not the first recommended model for any app
// eslint-disable-next-line @typescript-eslint/no-unused-vars
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Annotation will be removed in next step #3336

Copy link
Collaborator

@jeffmaury jeffmaury left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comments

@cbr7
Copy link
Contributor

cbr7 commented Jul 31, 2025

I'm not sure I understand what this PR is about? What is in the ai.json file that is being read?

@ScrewTSW
Copy link
Member Author

I'm not sure I understand what this PR is about? What is in the ai.json file that is being read?

All of the available inference servers, models and demo apps

@odockal
Copy link
Contributor

odockal commented Aug 1, 2025

This just creates objects with models, services, etc. It does not yet uses them.?

@cbr7
Copy link
Contributor

cbr7 commented Aug 1, 2025

I'm with @odockal on this, the data doesn't seem to be getting used for anything currently.

Also, what is the end goal of the data that will be read from the file? What should it be used for?

@ScrewTSW ScrewTSW force-pushed the 3333-tests-based-on-ai-json-poc branch from f9e9224 to b27dfd2 Compare August 1, 2025 11:19
@ScrewTSW
Copy link
Member Author

ScrewTSW commented Aug 1, 2025

This just creates objects with models, services, etc. It does not yet uses them.?

good catch, not sure how, but it slipped out when I was rewriting it from a diff

@ScrewTSW ScrewTSW marked this pull request as draft August 1, 2025 11:20
@ScrewTSW ScrewTSW force-pushed the 3333-tests-based-on-ai-json-poc branch 3 times, most recently from bca3d93 to 7b50dec Compare August 7, 2025 11:46
@ScrewTSW ScrewTSW force-pushed the 3333-tests-based-on-ai-json-poc branch from 7b50dec to 6ed26ef Compare August 20, 2025 14:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Investigate and prepare PoC how to parse and extract AI Apps from ai.json file and execute tests with parameters
4 participants