I am working on the inclusion of Kernel Bench in the inspect_evals repository here. To avoid duplication, I am very lightly wrapping the code here with the Inspect AI decorators.

I am running into issues using the prompt constructor methods after I have installed this as a dependency.

I believe that this is due to the prompts.toml file not being included in the wheel and/or how the prompt builder resolves the path.

I am fixing this locally to get past this blocker and can submit a PR when tested.

Thanks for your work on KernelBench! Excited for all the improvements ahead.