Skip to content

Commit 4472a16

Browse files
committed
Update with latest stats and add badges
1 parent 9d85bd4 commit 4472a16

File tree

2 files changed

+11
-9
lines changed

2 files changed

+11
-9
lines changed

artifacts/summary.json

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -2,31 +2,31 @@
22
{
33
"Provider": "Azure AI",
44
"Model": "gpt-4o",
5-
"Mean": 1.591
5+
"Mean": 2.414
66
},
77
{
88
"Provider": "Azure AI",
99
"Model": "gpt-4o-mini",
10-
"Mean": 2.681
10+
"Mean": 2.748
1111
},
1212
{
1313
"Provider": "OpenAI",
1414
"Model": "gpt-4o",
15-
"Mean": 2.522
15+
"Mean": 2.646
1616
},
1717
{
1818
"Provider": "OpenAI",
1919
"Model": "gpt-4o-mini",
20-
"Mean": 2.613
20+
"Mean": 2.844
2121
},
2222
{
2323
"Provider": "xAI",
2424
"Model": "grok-2-latest",
25-
"Mean": 3.002
25+
"Mean": 1.628
2626
},
2727
{
2828
"Provider": "xAI",
2929
"Model": "grok-beta",
30-
"Mean": 1.326
30+
"Mean": 1.731
3131
}
32-
]
32+
]

readme.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,12 @@ to compare the relative performance of OpenAI, AzureAI and xAI, using the same c
66
Currently, comparison includes:
77

88
* OpenAI: gpt-4o, gpt-4o-mini
9-
* AzureAI: gpt-40, gpt-4o-mini
9+
* AzureAI: gpt-4o, gpt-4o-mini
1010
* xAI: grok-beta, grok-2-latest
1111

12-
![NuGet Packages](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fgithub.com%2Fdevlooped%2Fnuget%2Fraw%2Frefs%2Fheads%2Fmain%2Fnuget.json&query=%24.summary.packages&style=social&logo=nuget&label=packages)
12+
![xAI grok2](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fgithub.com%2Fdevlooped%2FAI.Benchmarks%2Fraw%2Frefs%2Fheads%2Fmain%2Fartifacts%2Fsummary.json&query=%24.[4].Mean&logo=x&label=grok2)
13+
![Azure gpt-4o](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fgithub.com%2Fdevlooped%2FAI.Benchmarks%2Fraw%2Frefs%2Fheads%2Fmain%2Fartifacts%2Fsummary.json&query=%24.[0].Mean&label=gpt-4o&logo=data:image/svg+xml;base64,PHN2ZyBpZD0idXVpZC1hZGJkYWU4ZS01YTQxLTQ2ZDEtOGMxOC1hYTczY2RiZmVlMzIiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyIgd2lkdGg9IjE4IiBoZWlnaHQ9IjE4IiB2aWV3Qm94PSIwIDAgMTggMTgiPjxkZWZzPjxyYWRpYWxHcmFkaWVudCBpZD0idXVpZC0yYTc0MDdhYS1iNzg3LTQ4ZGQtYTk2YS0wZDgxYWI2ZTkzYmIiIGN4PSItNjcuOTgxIiBjeT0iNzkzLjE5OSIgcj0iLjQ1IiBncmFkaWVudFRyYW5zZm9ybT0idHJhbnNsYXRlKC0xNzkzOS4wMyAyMDM2OC4wMjkpIHJvdGF0ZSg0NSkgc2NhbGUoMjUuMDkxIC0zNC4xNDkpIiBncmFkaWVudFVuaXRzPSJ1c2VyU3BhY2VPblVzZSI+PHN0b3Agb2Zmc2V0PSIwIiBzdG9wLWNvbG9yPSIjODNiOWY5IiAvPjxzdG9wIG9mZnNldD0iMSIgc3RvcC1jb2xvcj0iIzAwNzhkNCIgLz48L3JhZGlhbEdyYWRpZW50PjwvZGVmcz48cGF0aCBkPSJtMCwyLjd2MTIuNmMwLDEuNDkxLDEuMjA5LDIuNywyLjcsMi43aDEyLjZjMS40OTEsMCwyLjctMS4yMDksMi43LTIuN1YyLjdjMC0xLjQ5MS0xLjIwOS0yLjctMi43LTIuN0gyLjdDMS4yMDksMCwwLDEuMjA5LDAsMi43Wk0xMC44LDB2My42YzAsMy45NzYsMy4yMjQsNy4yLDcuMiw3LjJoLTMuNmMtMy45NzYsMC03LjE5OSwzLjIyMi03LjIsNy4xOTh2LTMuNTk4YzAtMy45NzYtMy4yMjQtNy4yLTcuMi03LjJoMy42YzMuOTc2LDAsNy4yLTMuMjI0LDcuMi03LjJaIiBmaWxsPSJ1cmwoI3V1aWQtMmE3NDA3YWEtYjc4Ny00OGRkLWE5NmEtMGQ4MWFiNmU5M2JiKSIgc3Ryb2tlLXdpZHRoPSIwIiAvPjwvc3ZnPg==)
14+
![OpenAI gpt-4o](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fgithub.com%2Fdevlooped%2FAI.Benchmarks%2Fraw%2Frefs%2Fheads%2Fmain%2Fartifacts%2Fsummary.json&query=%24.[4].Mean&logo=openai&label=gpt-4o)
1315

1416
Prompt:
1517

0 commit comments

Comments
 (0)