Could you provide images compatible with SWE-agent for experiments?

[orreroing]

Hi！

Currently, I am trying to run SWEBenchPro in a Docker environment using SWEAgent. However, some official images are not fully compatible with SWEAgent, which makes setup and test execution challenging. I attempted to manually fix the issues within the container. Initially, I encountered problems with pip downloads, which were resolved after specifying a download source. However, when running pipx run swe-rex, another issue appeared: "'swe-rex' executable script not found in package 'swe-rex'."

I believe that providing an official Docker image adapted for SWEAgent configuration (similar to the image you provide for SWEBench) would be very helpful. This would simplify the deployment process and improve reproducibility for users who wish to run SWEBenchPro in a containerized environment.

Thank you for considering this request!

[jeff-da]

Hey @orreroing , sorry about the trouble, and thanks for the interest!

We use SWE-Agent although the version we used was from a few months ago. @18vijayb uploaded this version to the Github, could you give it a shot? (it's in the sweagent folder)

It should work out of the box. If there's still an issue with swe-rex, could you try pip install -e . after cloning https://github.com/jeff-da/SWE-ReX/tree/sweap-support?

[jeff-da]

Hey @orreroing ,

To follow up, are you using the dockerfiles or the images on DockerHub? We recommend using the DockerHub images because they are deterministic

[orreroing]

Hey @orreroing ,

To follow up, are you using the dockerfiles or the images on DockerHub? We recommend using the DockerHub images because they are deterministic

Thank you so much for your reply ! ! !

In my existing swe-agent environment, I tried using the image path you provided via the swe-agent command-line argument --env.deployment.image. It successfully pulled the image from Docker Hub.
However, when I try to run it, I encounter an error: "'swe-rex' executable script not found in package 'swe-rex'".
(Maybe this could be a Python version mismatch? I'm not sure why this error is occurring.)
This is the full command generated by swe-agent. Therefore, I am unable to use your image directly within my existing swe-agent environment.

If your image could be adapted to be compatible with swe-agent, I think it would be a great help.

[orreroing]

Hey @orreroing ,

To follow up, are you using the dockerfiles or the images on DockerHub? We recommend using the DockerHub images because they are deterministic

Additionally, I noticed that some images might be directly usable. For instance, I was successful when I tried the 'instance_qutebrowser__qutebrowser-f91ace9' instance. This might be helpful for adapting the image.

[jeff-da]

Hey @orreroing , we added a set of scripts for running SWE-Agent in the sweagent folder in this repo. Could you try pulling from latest and running that?

[jeff-da]

Notably, I think getting the justfile part working will fix the swe-rex error

[orreroing]

Notably, I think getting the justfile part working will fix the swe-rex error

Hi , I've successfully resolved the issue!

The problem was located in /SWE-ReX/src/swerex/deployment/docker.py. Specifically, within the _get_swerex_start_cmd function, the initial handling to ensure pipx is fully downloaded and installed seems to be incomplete.

After taking inspiration from how modal handles this process（function：ensure_pipx_installed）, I was able to modify it and successfully run the experiments in Docker using your image. While my local fix gets the job done, I'm aware it might not be a fully comprehensive solution.

I highly recommend enhancing this function. A more robust implementation here would make the setup process much smoother and more convenient for all users.

Thank you again for all your great work!