title	Code Debug Environment
emoji	🐛
colorFrom	blue
colorTo	purple
sdk	docker
app_port	7860
tags	openenv code-debugging reinforcement-learning

Code Debug Environment

A Python code debugging environment built on OpenEnv. An AI agent receives broken Python code, fixes it, and the environment scores the fix by running it against test cases.

Built for the Meta x Scaler OpenEnv Hackathon.

---

How It Works

1. The environment presents broken Python code to the agent
2. The agent submits fixed code
3. The environment runs the fixed code against hidden test cases
4. The agent receives a score (0.0 to 1.0) and feedback on which tests failed
5. The agent can retry up to 5 times per task

There are 3 tasks with increasing difficulty. The agent must fix syntax errors, logic bugs, and interdependent bugs across multiple functions.

---

Project Structure

code_debug_env/
  models.py            - Pydantic models (Action, Observation, State)
  client.py            - OpenEnv client for connecting to the server
  inference.py         - LLM-based agent that solves all 3 tasks
  openenv.yaml         - OpenEnv manifest
  pyproject.toml       - Python project config
  Dockerfile           - Container config for deployment
  server/
    app.py             - FastAPI app entry point
    environment.py     - Core environment logic, tasks, and grading

---

Tasks

easy_001 (Easy) - Syntax Errors

Fix missing colons and parentheses in a calculate_average function.

• 5 test cases
• A basic LLM should fix this in 1 step

medium_001 (Medium) - Logic Errors

Fix logic bugs in is_palindrome (wrong comparison) and count_vowels (wrong increment). The code runs without errors but produces wrong results.

• 5 test cases
• Requires reading the code carefully, not just fixing syntax

hard_001 (Hard) - Interdependent Bugs

Fix 3 bugs across compress_stream, decompress_stream, and stream_stats. The bugs compensate for each other -- the broken code actually passes all tests as-is. Fixing only 1 or 2 bugs breaks everything. All 3 must be fixed together.

• 6 test cases
• Requires understanding how data flows between functions

---

Scoring

score = tests_passed / total_tests

• Partial credit is given. Passing 3 out of 5 tests = 0.6
• If the submitted code has a syntax error or crashes, score = 0.0
• Code that runs longer than 3 seconds is killed (catches infinite loops)
• An episode ends when score reaches 1.0 or after 5 steps

---

Action Space

What the agent sends to the environment:

Field	Type	Description
fixed_code	str	The corrected Python code
task_id	str	Which task is being solved

Observation Space

What the environment sends back:

Field	Type	Description
broken_code	str	The original broken code
description	str	What the task is about
score	float	0.0 to 1.0
tests_passed	int	How many tests passed
total_tests	int	Total test cases
feedback	str	Which tests failed and why
done	bool	Whether the episode is over
difficulty	str	easy, medium, or hard

---

Setup

Prerequisites

• Python 3.11+
• uv (recommended) or pip

Install dependencies

uv sync

Or with pip:

pip install openenv-core fastapi uvicorn openai

---

Running Locally

Step 1: Start the server

uv run server

Leave this running in a terminal. The server starts on port 7860.

Step 2: Run the agent

In a separate terminal:

export HF_TOKEN=your_huggingface_token
export MODEL_NAME=meta-llama/Llama-3.1-8B-Instruct
export ENV_URL=http://localhost:7860

uv run python inference.py

You should see output like:

Task: easy_001 (easy)
Step 1: score=1.0 tests=5/5

Task: medium_001 (medium)
Step 1: score=1.0 tests=5/5

Task: hard_001 (hard)
Step 1: score=0.0 tests=0/6
Step 2: score=1.0 tests=6/6

=== BASELINE SCORES ===
easy_001: 1.00
medium_001: 1.00
hard_001: 1.00
Average: 1.00

---

Docker

Build

docker build -t code-debug-env .

Run

docker run -p 7860:7860 code-debug-env

The server will be available at http://localhost:7860.

---

Deploy to Hugging Face Spaces

openenv push --repo-id your-username/code-debug-env

The Dockerfile is configured to expose port 7860, which is required by Hugging Face Spaces.

---

Baseline Scores

Tested with meta-llama/Llama-3.1-8B-Instruct:

Task	Difficulty	Score	Steps Needed
easy_001	Easy	1.00	1
medium_001	Medium	1.00	1
hard_001	Hard	1.00	2
Average	-	1.00	-

---

Environment Variables

Variable	Required	Default	Description
HF_TOKEN	Yes	-	Hugging Face API token
MODEL_NAME	Yes	-	Model to use for inference
API_BASE_URL	No	https://router.huggingface.co/v1	LLM API endpoint
ENV_URL	No	http://localhost:8000	Environment server URL