Discussions

• 1 You must be logged in to vote

  💡

  [Feature]: add reasoning/thinking capability and effort level in the benchmark logic

  Fango2007 started Jun 11, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature]: Improve cloud provider support

  Fango2007 started Jun 10, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature]: allow datasets to support attribute 'expected_output'.

  Fango2007 started Jun 9, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature] : Create a bank of LLM providers (Mistral, Qwen, etc..)

  Fango2007 started Apr 30, 2026 in Ideas · Closed

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature] : allow to plug the application to an external telemetry service

  Fango2007 started Apr 30, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature] : inspect directly a model to overcome the lack of info from an inference server

  Fango2007 started Apr 30, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature]: Support Anthropic API

  Fango2007 started Apr 30, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature] : Semantic tests

  Fango2007 started Mar 21, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  Manual models assessment based on a subset of a known dataset

  Fango2007 started Mar 19, 2026 in Ideas

  

  

  0