pydantic ai benchmarking support#574

KRRT7 merged 16 commits intomaincodeflash-ai/codeflash:mainfrom

easier-benchmarkcodeflash-ai/codeflash:easier-benchmarkCopy head branch name to clipboard