-
-
Notifications
You must be signed in to change notification settings - Fork 69
Model translategemma 27b
Ollama Model ID: translategemma:27b
| Metric | Value |
|---|---|
| Average Score | 🟡 7.6/10 |
| Accuracy | 8.0/10 |
| Fluency | 8.0/10 |
| Style | 7.0/10 |
| Languages Tested | 19 |
| Total Translations | 190 |
| Best Language | Portuguese (8.4) |
| Worst Language | Hindi (6.8) |
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Portuguese | 🟡 8.4 | 8.4 | 8.8 | 7.6 |
| 2 | Spanish | 🟡 8.2 | 8.4 | 8.6 | 7.8 |
| 3 | Russian | 🟡 8.2 | 8.5 | 8.3 | 7.4 |
| 4 | French | 🟡 8.1 | 8.2 | 8.6 | 7.1 |
| 5 | German | 🟡 8.1 | 8.2 | 8.5 | 7.6 |
| 6 | Italian | 🟡 8.1 | 8.3 | 8.5 | 7.3 |
| 7 | Chinese (Simplified) | 🟡 7.8 | 8.2 | 8.2 | 7.2 |
| 8 | Arabic | 🟡 7.8 | 8.1 | 8.1 | 7.1 |
| 9 | Chinese (Traditional) | 🟡 7.7 | 8.1 | 8.1 | 7.1 |
| 10 | Thai | 🟡 7.7 | 8.1 | 7.9 | 7.0 |
View all 19 languages
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Portuguese | 🟡 8.4 | 8.4 | 8.8 | 7.6 |
| 2 | Spanish | 🟡 8.2 | 8.4 | 8.6 | 7.8 |
| 3 | Russian | 🟡 8.2 | 8.5 | 8.3 | 7.4 |
| 4 | French | 🟡 8.1 | 8.2 | 8.6 | 7.1 |
| 5 | German | 🟡 8.1 | 8.2 | 8.5 | 7.6 |
| 6 | Italian | 🟡 8.1 | 8.3 | 8.5 | 7.3 |
| 7 | Chinese (Simplified) | 🟡 7.8 | 8.2 | 8.2 | 7.2 |
| 8 | Arabic | 🟡 7.8 | 8.1 | 8.1 | 7.1 |
| 9 | Chinese (Traditional) | 🟡 7.7 | 8.1 | 8.1 | 7.1 |
| 10 | Thai | 🟡 7.7 | 8.1 | 7.9 | 7.0 |
| 11 | Ukrainian | 🟡 7.6 | 8.2 | 8.0 | 7.2 |
| 12 | Vietnamese | 🟡 7.5 | 7.8 | 7.9 | 6.7 |
| 13 | Tamil | 🟡 7.3 | 8.1 | 7.6 | 6.8 |
| 14 | Japanese | 🟡 7.3 | 8.2 | 7.5 | 6.7 |
| 15 | Hebrew | 🟡 7.2 | 8.0 | 7.5 | 6.7 |
| 16 | Korean | 🟡 7.1 | 7.8 | 7.3 | 6.4 |
| 17 | Bengali | 🟠 6.9 | 7.6 | 7.4 | 6.3 |
| 18 | Polish | 🟠 6.8 | 7.3 | 7.4 | 6.2 |
| 19 | Hindi | 🟠 6.8 | 7.4 | 7.1 | 6.3 |
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Portuguese | 🟡 8.4 | 8.4 | 8.8 | 7.6 |
| Spanish | 🟡 8.2 | 8.4 | 8.6 | 7.8 |
| French | 🟡 8.1 | 8.2 | 8.6 | 7.1 |
| German | 🟡 8.1 | 8.2 | 8.5 | 7.6 |
| Italian | 🟡 8.1 | 8.3 | 8.5 | 7.3 |
| Polish | 🟠 6.8 | 7.3 | 7.4 | 6.2 |
Category Average: 🟡 8.0
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Russian | 🟡 8.2 | 8.5 | 8.3 | 7.4 |
| Ukrainian | 🟡 7.6 | 8.2 | 8.0 | 7.2 |
Category Average: 🟡 7.9
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Chinese (Simplified) | 🟡 7.8 | 8.2 | 8.2 | 7.2 |
| Chinese (Traditional) | 🟡 7.7 | 8.1 | 8.1 | 7.1 |
| Thai | 🟡 7.7 | 8.1 | 7.9 | 7.0 |
| Vietnamese | 🟡 7.5 | 7.8 | 7.9 | 6.7 |
| Tamil | 🟡 7.3 | 8.1 | 7.6 | 6.8 |
| Japanese | 🟡 7.3 | 8.2 | 7.5 | 6.7 |
| Korean | 🟡 7.1 | 7.8 | 7.3 | 6.4 |
| Bengali | 🟠 6.9 | 7.6 | 7.4 | 6.3 |
| Hindi | 🟠 6.8 | 7.4 | 7.1 | 6.3 |
Category Average: 🟡 7.3
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Arabic | 🟡 7.8 | 8.1 | 8.1 | 7.1 |
| Hebrew | 🟡 7.2 | 8.0 | 7.5 | 6.7 |
Category Average: 🟡 7.5
Spanish - Pride and Prejudice Score: 🟢 10.0/10
View Translation
Original:
Translation:
Es una verdad universalmente reconocida que un hombre soltero que posea una buena fortuna debe estar necesitado de una esposa. Por poco que se conozcan los sentimientos o las intenciones de un hombre al llegar a un barrio, esta verdad está tan arraigada en las mentes de las familias vecinas que se le considera como la legítima propiedad de alguna de sus hijas.
Feedback: This is a classic, highly accurate translation that perfectly captures Austen's ironic tone and formal syntax. The choice of 'legítima propiedad' and 'arraigada' maintains the precise weight of the original vocabulary.
Polish - The Picture of Dorian Gray Score: ⚫ 1.0/10
View Translation
Original:
Translation:
Studio wypełniał bogaty zapach róż, a gdy lekki, letni wiatr poruszał gałęziami drzew w ogrodzie, przez otwarte drzwi dobiegał ciężki aromat bzów lub delikatniejszy zapach różowych kwiatów dzikiej róży. Z rogu perskiego dywanu, na którym leżał, paląc, jak zwykle, niezliczoną ilość papierosów, lord Henry Wotton mógł dostrzec poświatę miodowożółtych kwiatów złotokrzewa.
Feedback: Failed to parse evaluation response
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 40 | 21.1% |
| 🟡 Good (7-8) | 120 | 63.2% |
| 🟠 Acceptable (5-6) | 28 | 14.7% |
| 🔴 Poor (3-4) | 0 | 0.0% |
| ⚫ Failed (1-2) | 2 | 1.1% |
| Metric | Value |
|---|---|
| Average Translation Time | 4546.0ms |
| Success Rate | 100.0% |