Merge pull request #431 from symflower/v1.0-last-steps

Integrate v1.0 results

Author: zimmski

README.md

@@ -4,14 +4,20 @@ An evaluation benchmark 📈 and framework to compare and evolve the quality of
 
 This repository gives developers of LLMs (and other code generation tools) a standardized benchmark and framework to improve real-world usage in the software development domain and provides users of LLMs with metrics and comparisons to check if a given LLM is useful for their tasks.
 
-The latest results are discussed in a deep dive: [OpenAI's o1-preview is the king 👑 of code generation but is super slow and expensive](https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.6-o1-preview-is-the-king-of-code-generation-but-is-super-slow-and-expensive/)
+The latest results are discussed in a deep dive: [Anthropic's Claude 3.7 Sonnet is the new king 👑 of code generation (but only with help), and DeepSeek R1 disappoints (Deep dives from the DevQualityEval v1.0)](https://symflower.com/en/company/blog/2025/dev-quality-eval-v1.0-anthropic-s-claude-3.7-sonnet-is-the-king-with-help-and-deepseek-r1-disappoints/)
 
-![Scatter plot that shows the best LLMs aligned with their capability on the y-axis to costs with a logarithmic scale on the x-axis of the v0.6 deep dive.](https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.6-o1-preview-is-the-king-of-code-generation-but-is-super-slow-and-expensive/images/header.png)
+![Cost-effectiveness scatter plot that shows the best LLMs aligned with their capability on the y-axis to the average costs per API request with a logarithmic scale on the x-axis solving 760 benchmark cases.](https://symflower.com/en/company/blog/2025/dev-quality-eval-v1.0-anthropic-s-claude-3.7-sonnet-is-the-king-with-help-and-deepseek-r1-disappoints/images/header.png)
 
-> [!TIP]
-> **💰🍻 [Buy us 2 beverages](https://symflower.com/en/products/devqualityeval-leaderboard/) to support us in extending the DevQualityEval project** and gain access to the entire dataset of DevQualityEval logs and results from the latest benchmark run.
+[![Buy us 2 beverages to support the DevQualityEval project](docs/cta.svg)](https://buy.stripe.com/5kA3g962hfP0dGMeUX)
 
-![Buy us 2 beverages to support the DevQualityEval project](docs/cta.svg)
+> 💰🍻 With [this purchase](https://buy.stripe.com/5kA3g962hfP0dGMeUX) you are mainly supporting DevQualityEval but you also receive access via your Google account to the detailed results of DevQualityEval v1.0 This includes: Access to the Google Sheet document with the leaderboard summary, as well as graphs, and exported metrics.
+
+Since all deep dives build upon each other, it is worth taking a look at previous dives:
+
+- [OpenAI's o1-preview is the king 👑 of code generation but is super slow and expensive (Deep dives from the DevQualityEval v0.6)](https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.6-o1-preview-is-the-king-of-code-generation-but-is-super-slow-and-expensive/)
+- [DeepSeek v2 Coder and Claude 3.5 Sonnet are more cost-effective at code generation than GPT-4o! (Deep dives from the DevQualityEval v0.5.0)](https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.5.0-deepseek-v2-coder-and-claude-3.5-sonnet-beat-gpt-4o-for-cost-effectiveness-in-code-generation/)
+- [Is Llama-3 better than GPT-4 for generating tests? And other deep dives of the DevQualityEval v0.4.0](https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/)
+- [Can LLMs test a Go function that does nothing?](https://symflower.com/en/company/blog/2024/can-ai-test-a-go-function-that-does-nothing/)
 
 ## Installation