[API BUG]

[bhavishya-pohani]

We had to rate limit you, you hit the quota of 3000 api requests per 5 minutes period. Upgrade to higher plan to get higher limits (current: team). See https://huggingface.co/docs/hub/rate-limits�[0m
2025-10-22 15:38:49,173 - MainThread - INFO - httpx - HTTP Request: GET https://raw.githubusercontent.com/BerriAI/litellm/main/model_prices_and_context_window.json "HTTP/1.1 200 OK"
�[33;1m2025-10-22 15:38:49,471 - MainThread - WARNING - are.simulation.scenarios.scenario_imported_from_json.utils - Scenario duration overridden to 1800 instead of 1000.0 seconds�[0m
2025-10-22 15:38:49,740 - MainThread - INFO - are.simulation.scenarios.scenario_imported_from_json.utils - [scenario_universe_21_pbnqu9]: Initializing turns with judge trigger condition
2025-10-22 15:38:49,740 - MainThread - INFO - are.simulation.scenarios.scenario_imported_from_json.utils - [scenario_universe_21_pbnqu9]: Validation mode online
2025-10-22 15:38:49,741 - MainThread - INFO - are.simulation.scenarios.scenario_imported_from_json.utils - [scenario_universe_21_pbnqu9]: Scenario has 1 turns
2025-10-22 15:38:49,746 - MainThread - INFO - are.simulation.scenario_runner - [Scenario = scenario_universe_21_pbnqu9, Run = 1] Running with Agent default
�[33;1m2025-10-22 15:38:49,757 - MainThread - WARNING - are.simulation.agents.default_agent.are_simulation_main - [Scenario = scenario_universe_21_pbnqu9, Run = 1] Setting wait_for_user_response to False in AgentUserInterface�[0m
�[33;1m2025-10-22 15:38:49,757 - MainThread - WARNING - are.simulation.agents.default_agent.are_simulation_main - [Scenario = scenario_universe_21_pbnqu9, Run = 1] Removing tools {'AgentUserInterface__get_all_messages', 'AgentUserInterface__get_last_unread_messages', 'AgentUserInterface__get_last_message_from_agent', 'AgentUserInterface__get_last_message_from_user'} from app_tools�[0m
�[33;1m2025-10-22 15:38:49,757 - MainThread - WARNING - are.simulation.agents.default_agent.are_simulation_main - [Scenario = scenario_universe_21_pbnqu9, Run = 1] Setting agent max_turns to 1�[0m
�[33;1m2025-10-22 15:38:48,913 - MainThread - WARNING - are.simulation.apps.utils.fallback_file_system - Failed to lazy load stats for /Pictures/llama.jpg: 429 Client Error: Too Many Requests for url: https://huggingface.co/api/datasets/meta-agents-research-environments/gaia2_filesystem/paths-info/main (Request ID: Root=1-68f932c8-3db829446e2e974210efb326;2602884d-456b-4c3f-9e1c-92f4b9acf5c5)

I am consistently seeing rate limit errors. Is there a way to solve this via downloading the dataset all at once? Can this be enabled?

[bhavishya-pohani]

@Mortimerp9 any thoughts?

[Marc-antoineallard74]

Hello,

I encountered the same issue and believe I’ve managed to resolve it.
My assumption is that the rate limiting comes from lazy loading of file metadata from the Hugging Face dataset meta-agents-research-environments/gaia2_filesystem.

After downloading the dataset metadata locally using:

huggingface-cli download meta-agents-research-environments/gaia2_filesystem --local-dir <YOUR_PATH> --repo-type dataset

and updating the .env file with:

DEMO_FS_PATH="<YOUR_PATH>/demo_filesystem"

it seems to have stopped the excessive API requests to Hugging Face.

It would be great if contributors could look into this further or confirm the fix.

Thanks.

[bhavishya-pohani]

+1 found that worked for me as well

[Mortimerp9]

@Marc-antoineallard74 , thanks for finding this solution, there seems to be an issue with the lazy load indeed. I will see if there is a way to make this a one off on our side.