-
-
Notifications
You must be signed in to change notification settings - Fork 72
Model translategemma 27b it q8_0
Ollama Model ID: translategemma:27b-it-q8_0
| Metric | Value |
|---|---|
| Average Score | 🟡 7.1/10 |
| Accuracy | 7.5/10 |
| Fluency | 7.1/10 |
| Style | 6.6/10 |
| Languages Tested | 19 |
| Total Translations | 95 |
| Best Language | French (7.8) |
| Worst Language | Tamil (6.2) |
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | French | 🟡 7.8 | 7.8 | 8.0 | 7.2 |
| 2 | German | 🟡 7.8 | 7.8 | 7.6 | 7.2 |
| 3 | Spanish | 🟡 7.6 | 8.2 | 7.4 | 7.4 |
| 4 | Portuguese | 🟡 7.6 | 8.0 | 7.6 | 7.0 |
| 5 | Italian | 🟡 7.4 | 7.8 | 7.4 | 6.8 |
| 6 | Chinese (Traditional) | 🟡 7.4 | 7.8 | 7.2 | 7.0 |
| 7 | Russian | 🟡 7.4 | 7.6 | 7.6 | 6.6 |
| 8 | Arabic | 🟡 7.4 | 7.4 | 7.4 | 6.4 |
| 9 | Polish | 🟡 7.2 | 7.4 | 7.2 | 6.8 |
| 10 | Chinese (Simplified) | 🟡 7.2 | 7.6 | 7.2 | 6.6 |
View all 19 languages
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | French | 🟡 7.8 | 7.8 | 8.0 | 7.2 |
| 2 | German | 🟡 7.8 | 7.8 | 7.6 | 7.2 |
| 3 | Spanish | 🟡 7.6 | 8.2 | 7.4 | 7.4 |
| 4 | Portuguese | 🟡 7.6 | 8.0 | 7.6 | 7.0 |
| 5 | Italian | 🟡 7.4 | 7.8 | 7.4 | 6.8 |
| 6 | Chinese (Traditional) | 🟡 7.4 | 7.8 | 7.2 | 7.0 |
| 7 | Russian | 🟡 7.4 | 7.6 | 7.6 | 6.6 |
| 8 | Arabic | 🟡 7.4 | 7.4 | 7.4 | 6.4 |
| 9 | Polish | 🟡 7.2 | 7.4 | 7.2 | 6.8 |
| 10 | Chinese (Simplified) | 🟡 7.2 | 7.6 | 7.2 | 6.6 |
| 11 | Ukrainian | 🟡 7.0 | 7.4 | 7.2 | 6.4 |
| 12 | Hebrew | 🟡 7.0 | 7.6 | 6.8 | 6.8 |
| 13 | Japanese | 🟠 6.8 | 7.4 | 6.8 | 6.4 |
| 14 | Vietnamese | 🟠 6.8 | 7.4 | 6.6 | 6.4 |
| 15 | Hindi | 🟠 6.6 | 7.4 | 6.6 | 6.2 |
| 16 | Bengali | 🟠 6.6 | 7.2 | 6.6 | 6.0 |
| 17 | Korean | 🟠 6.4 | 7.0 | 6.4 | 5.8 |
| 18 | Thai | 🟠 6.4 | 7.4 | 6.4 | 6.2 |
| 19 | Tamil | 🟠 6.2 | 7.0 | 6.2 | 5.8 |
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| French | 🟡 7.8 | 7.8 | 8.0 | 7.2 |
| German | 🟡 7.8 | 7.8 | 7.6 | 7.2 |
| Spanish | 🟡 7.6 | 8.2 | 7.4 | 7.4 |
| Portuguese | 🟡 7.6 | 8.0 | 7.6 | 7.0 |
| Italian | 🟡 7.4 | 7.8 | 7.4 | 6.8 |
| Polish | 🟡 7.2 | 7.4 | 7.2 | 6.8 |
Category Average: 🟡 7.6
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Chinese (Traditional) | 🟡 7.4 | 7.8 | 7.2 | 7.0 |
| Chinese (Simplified) | 🟡 7.2 | 7.6 | 7.2 | 6.6 |
| Japanese | 🟠 6.8 | 7.4 | 6.8 | 6.4 |
| Vietnamese | 🟠 6.8 | 7.4 | 6.6 | 6.4 |
| Hindi | 🟠 6.6 | 7.4 | 6.6 | 6.2 |
| Bengali | 🟠 6.6 | 7.2 | 6.6 | 6.0 |
| Korean | 🟠 6.4 | 7.0 | 6.4 | 5.8 |
| Thai | 🟠 6.4 | 7.4 | 6.4 | 6.2 |
| Tamil | 🟠 6.2 | 7.0 | 6.2 | 5.8 |
Category Average: 🟠 6.7
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Russian | 🟡 7.4 | 7.6 | 7.6 | 6.6 |
| Ukrainian | 🟡 7.0 | 7.4 | 7.2 | 6.4 |
Category Average: 🟡 7.2
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Arabic | 🟡 7.4 | 7.4 | 7.4 | 6.4 |
| Hebrew | 🟡 7.0 | 7.6 | 6.8 | 6.8 |
Category Average: 🟡 7.2
French - Pride and Prejudice Score: 🟢 9.0/10
View Translation
Original:
Translation:
Il est une vérité universellement reconnue qu’un homme célibataire en possession d’une fortune considérable doit être dans le besoin d’une épouse. Aussi peu que l’on puisse connaître les sentiments ou les intentions d’un tel homme lorsqu’il s’installe dans un quartier, cette vérité est tellement ancrée dans l’esprit des familles voisines qu’il est considéré comme la propriété légitime de l’une ou l’autre de leurs filles.
Feedback: The translation faithfully preserves Austen's meaning and ironic tone, with excellent word choices like 'vérité universellement reconnue' and 'propriété légitime' that capture the original's satirical voice. Minor stylistic variations ('quartier' for 'neighbourhood' is slightly less precise) prevent a perfect score, but overall this is an exemplary translation that reads naturally in French.
Korean - Pride and Prejudice Score: 🟠 5.0/10
View Translation
Original:
Translation:
꽤나 알려진 사실이지만, 재산이 넉넉한 총각은 반드시 아내가 필요할 것이다. 그런 남자의 생각이나 감정이 처음 이웃에 나타났을 때 얼마나 알려지지 않았든, 이 사실은 주변 사람들의 마음속에 깊이 자리 잡고 있어서, 그 남자는 당연히 그들의 딸들 중 누군가의 짝이 될 것이라고 여겨진다.
Feedback: The translation captures the basic meaning but loses Austen's signature irony and the universally acknowledged truth's satirical weight. The phrase '꽤나 알려진 사실이지만' (fairly well-known fact) weakens the opening's ironic certainty, and the prose feels awkward and overly literal rather than flowing naturally in Korean, failing to preserve the elegant, tongue-in-cheek tone of the original.
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 1 | 1.1% |
| 🟡 Good (7-8) | 73 | 76.8% |
| 🟠 Acceptable (5-6) | 21 | 22.1% |
| 🔴 Poor (3-4) | 0 | 0.0% |
| ⚫ Failed (1-2) | 0 | 0.0% |
| Metric | Value |
|---|---|
| Average Translation Time | 25494.0ms |
| Success Rate | 100.0% |