Skip to content

Faster TestGen (A/B testing branch) (CF-621) #186

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 10 commits into from
Closed

Faster TestGen (A/B testing branch) (CF-621) #186

wants to merge 10 commits into from

Conversation

@aseembits93
Copy link
Contributor

@aseembits93 aseembits93 commented May 6, 2025 •
edited
Loading

User description

Current Test Generation Workflow is relatively slower, with this PR would make it much faster.

PR Type

Documentation

Description

  • Add a TODO comment in optimize_function

Changes walkthrough 📝

Relevant files
Documentation
function_optimizer.py
Add A/B testing TODO comment                                                         

codeflash/optimization/function_optimizer.py

  • Inserted a TODO comment for A/B testing
 +1/-0     
Need help?
  • Type /help how to ... in the comments thread for any questions about PR-Agent usage.
  • Check out the documentation for more information.
    •

    @github-actions
    Copy link

    github-actions bot commented May 6, 2025

    PR Reviewer Guide 🔍

    Here are some key observations to aid the review process:

    ⏱️ Estimated effort to review: 1 🔵⚪⚪⚪⚪
    🧪 No relevant tests
    🔒 No security concerns identified
    ⚡ Recommended focus areas for review

    Ambiguous TODO

    The new TODO comment is vague about the specifics of “a/b testing” and the differences in test generation strategies. Clarify what variants should be compared and the expected metrics or criteria.

     
    #TODO: do a/b testing with same codegen but different testgen

    @github-actions
    Copy link

    github-actions bot commented May 6, 2025

    PR Code Suggestions ✨

    No code suggestions found for the PR.

    codeflash-ai bot added a commit that referenced this pull request May 7, 2025
    @codeflash-ai
    ⚡️ Speed up function ask_for_telemetry by 14% in PR #186 (cf-621)
    5c34cc0 
    Here is an optimized version of your program.



**Optimization applied:**
- The `from rich.prompt import Confirm` import has been moved to the top level. 
    - This avoids re-importing the module every time `ask_for_telemetry()` is called, which saves unnecessary import overhead and speeds up repeated calls.
    @codeflash-ai codeflash-ai bot mentioned this pull request May 7, 2025
    Closed
    @codeflash-ai
    Copy link
    Contributor

    codeflash-ai bot commented May 7, 2025

    ⚡️ Codeflash found optimizations for this PR

    📄 14% (0.14x) speedup for ask_for_telemetry in codeflash/cli_cmds/cmd_init.py

    ⏱️ Runtime : 5.81 milliseconds → 5.08 milliseconds (best of 372 runs)

    I created a new dependent PR with the suggested changes. Please review:

    If you approve, it will be merged into this PR (branch cf-621).

    @aseembits93 aseembits93 changed the title Faster TestGen (CF-621) Faster TestGen (A/B testing branch) (CF-621) May 9, 2025
    @github-actions github-actions bot added the workflow-modified This PR modifies GitHub Actions workflows label May 12, 2025
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

    Reviewers

    No reviews

    Assignees

    No one assigned

    Labels

    Review effort 1/5 workflow-modified This PR modifies GitHub Actions workflows

    Projects

    None yet

    Milestone

    No milestone

    Development

    Successfully merging this pull request may close these issues.

    2 participants

    @aseembits93