Skip to content

Conversation

@chenyushuo
Copy link
Collaborator

Description

As the title says.

Checklist

Please check the following items before code is ready to be reviewed.

  • Code has passed all tests
  • Docstrings have been added/updated in Google Style
  • Documentation has been updated
  • Code is ready for review

@gemini-code-assist
Copy link
Contributor

Summary of Changes

Hello @chenyushuo, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request refines the configuration of VLLM sampling parameters by removing specific defaults, allowing for more flexible parameter handling. Concurrently, it introduces a BaseSimpleWorkflow class to establish a common foundation for SimpleWorkflow and AsyncSimpleWorkflow, thereby improving the modularity and maintainability of the workflow system.

Highlights

  • VLLM Sampling Parameters Refinement: The temperature and max_tokens parameters have been removed from the default_sampling_params initialization in vllm_model.py. This change suggests a move towards more dynamic or external configuration of these specific sampling parameters.
  • Workflow Class Refactoring: The SimpleWorkflow class has been refactored into a new BaseSimpleWorkflow parent class. Both the SimpleWorkflow and AsyncSimpleWorkflow now inherit from this new base class, establishing a clearer inheritance hierarchy and promoting code reuse for common workflow functionalities.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a valuable refactoring in trinity/common/workflows/workflow.py by creating a BaseSimpleWorkflow to share common logic between SimpleWorkflow and AsyncSimpleWorkflow. This not only improves code reuse but also appears to fix an issue where AsyncSimpleWorkflow was missing necessary methods. The change in trinity/common/models/vllm_model.py correctly removes temperature and max_tokens from the default SamplingParams, allowing them to be controlled at the engine level, which is more appropriate. I have one suggestion to improve the __init__ method convention in the new base class.

@chenyushuo
Copy link
Collaborator Author

/unittest-module-common

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
34 34 0 0 0 0 3m 54s

Tests

Test Name Status Flaky Duration
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 41.0s
tests/common/config_test.py::TestConfig::test_config_flatten 39ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 425ms
tests/common/config_test.py::TestConfig::test_default_workflow 88ms
tests/common/config_test.py::TestConfig::test_load_default_config 3.5s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly 90ms
tests/common/config_test.py::TestConfig::test_optimizer_config_propagation 89ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster 1.8s
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion 15ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 2ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 28.7s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 16.2s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 20.5s
tests/common/vllm_test.py::TestModelLen_0::test_model_len 17.3s
tests/common/vllm_test.py::TestModelLen_1::test_model_len 17.4s
tests/common/vllm_test.py::TestAPIServer::test_api 22.4s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async 22.9s
tests/common/vllm_test.py::TestTokenizer::test_action_mask 253ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools 247ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 19.7s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 17.8s

Github Test Reporter by CTRF 💚

@chenyushuo
Copy link
Collaborator Author

/unittest-module-explorer

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
37 35 1 1 0 0 10m 4s

Failed Tests

Failed Tests ❌ Fail Message
❌ tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer The test failed in the call phase due to an exception

Skipped

Tests Status
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter skipped ⏭️

Tests

Test Name Status Flaky Duration
tests/explorer/explorer_test.py::TestExplorerCountdownMaxRepeatTimes::test_explorer 1m 24s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer 1m 10s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer 1m 44s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer 27.4s
tests/explorer/explorer_test.py::ServeTest::test_serve 1m 20s
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow 12.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations 12.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results 30.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution 12.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow 12.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods 22.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop 23.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks 15.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid 12.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all 15.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch 21.1s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1 602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1 1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps 1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow 35ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow 24ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow 174ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow 3ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow 13ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow 8ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow 86ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1 101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1 201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow 15.2s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow 14.5s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter ⏭️ 1ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner 292ms

Github Test Reporter by CTRF 💚

@chenyushuo
Copy link
Collaborator Author

/unittest-module-explorer

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
36 35 0 1 0 0 12m 5s

Skipped

Tests Status
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter skipped ⏭️

Tests

Test Name Status Flaky Duration
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer 1m 18s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer 1m 42s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer 3m 38s
tests/explorer/explorer_test.py::ServeTest::test_serve 1m 27s
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow 12.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations 12.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results 30.9s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution 12.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow 12.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods 22.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop 23.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks 15.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid 12.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all 15.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch 20.9s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0 2ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1 602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1 1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps 1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow 35ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow 25ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow 175ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow 4ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow 13ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow 8ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow 88ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1 101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1 201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow 15.3s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow 15.8s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter ⏭️ 1ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner 292ms

Github Test Reporter by CTRF 💚

@pan-x-c pan-x-c merged commit 73c81b7 into modelscope:main Nov 12, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants