Multi Ifeval

An automatically generated multilingual version of IFEval, for 300+ languages.

---

Developer:

• Dan Saattrup Smart (dan.smart@alexandra.dk)

Setup

Installation

1. Run make install, which sets up a virtual environment and all Python dependencies therein.
2. Run source .venv/bin/activate to activate the virtual environment.

Quickstart

Run uv run src/scripts/translate_ifeval.py to translate the IFEval dataset to different languages. By default this uses the Gemini-3-flash model, which requires you to have set the GEMINI_API_KEY environment variable. You can also specify a different model with the --model flag.