-
-
Notifications
You must be signed in to change notification settings - Fork 73
Model ministral 3 14b
Ollama Model ID: ministral-3:14b
| Metric | Value |
|---|---|
| Average Score | 🟠 6.9/10 |
| Accuracy | 7.4/10 |
| Fluency | 6.9/10 |
| Style | 6.6/10 |
| Languages Tested | 19 |
| Total Translations | 95 |
| Best Language | French (8.2) |
| Worst Language | Tamil (5.6) |
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | French | 🟡 8.2 | 8.2 | 8.2 | 7.6 |
| 2 | German | 🟡 8.0 | 8.4 | 7.8 | 7.8 |
| 3 | Spanish | 🟡 7.8 | 8.2 | 7.8 | 7.8 |
| 4 | Portuguese | 🟡 7.6 | 8.0 | 7.6 | 7.2 |
| 5 | Polish | 🟡 7.6 | 8.0 | 7.4 | 7.2 |
| 6 | Russian | 🟡 7.6 | 7.8 | 7.8 | 7.2 |
| 7 | Chinese (Simplified) | 🟡 7.4 | 7.4 | 7.6 | 6.6 |
| 8 | Chinese (Traditional) | 🟡 7.2 | 7.6 | 7.2 | 6.8 |
| 9 | Ukrainian | 🟡 7.2 | 7.4 | 7.2 | 6.6 |
| 10 | Italian | 🟡 7.0 | 7.6 | 6.8 | 7.0 |
View all 19 languages
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | French | 🟡 8.2 | 8.2 | 8.2 | 7.6 |
| 2 | German | 🟡 8.0 | 8.4 | 7.8 | 7.8 |
| 3 | Spanish | 🟡 7.8 | 8.2 | 7.8 | 7.8 |
| 4 | Portuguese | 🟡 7.6 | 8.0 | 7.6 | 7.2 |
| 5 | Polish | 🟡 7.6 | 8.0 | 7.4 | 7.2 |
| 6 | Russian | 🟡 7.6 | 7.8 | 7.8 | 7.2 |
| 7 | Chinese (Simplified) | 🟡 7.4 | 7.4 | 7.6 | 6.6 |
| 8 | Chinese (Traditional) | 🟡 7.2 | 7.6 | 7.2 | 6.8 |
| 9 | Ukrainian | 🟡 7.2 | 7.4 | 7.2 | 6.6 |
| 10 | Italian | 🟡 7.0 | 7.6 | 6.8 | 7.0 |
| 11 | Japanese | 🟠 6.6 | 7.2 | 6.6 | 6.0 |
| 12 | Hindi | 🟠 6.6 | 7.2 | 6.6 | 6.2 |
| 13 | Bengali | 🟠 6.6 | 7.2 | 6.2 | 6.6 |
| 14 | Vietnamese | 🟠 6.4 | 7.2 | 6.4 | 6.2 |
| 15 | Hebrew | 🟠 6.2 | 7.0 | 6.2 | 6.2 |
| 16 | Korean | 🟠 6.0 | 6.8 | 6.0 | 5.6 |
| 17 | Thai | 🟠 6.0 | 7.0 | 6.0 | 6.0 |
| 18 | Arabic | 🟠 5.8 | 6.8 | 5.8 | 5.8 |
| 19 | Tamil | 🟠 5.6 | 6.4 | 5.4 | 5.2 |
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| French | 🟡 8.2 | 8.2 | 8.2 | 7.6 |
| German | 🟡 8.0 | 8.4 | 7.8 | 7.8 |
| Spanish | 🟡 7.8 | 8.2 | 7.8 | 7.8 |
| Portuguese | 🟡 7.6 | 8.0 | 7.6 | 7.2 |
| Polish | 🟡 7.6 | 8.0 | 7.4 | 7.2 |
| Italian | 🟡 7.0 | 7.6 | 6.8 | 7.0 |
Category Average: 🟡 7.7
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Russian | 🟡 7.6 | 7.8 | 7.8 | 7.2 |
| Ukrainian | 🟡 7.2 | 7.4 | 7.2 | 6.6 |
Category Average: 🟡 7.4
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Chinese (Simplified) | 🟡 7.4 | 7.4 | 7.6 | 6.6 |
| Chinese (Traditional) | 🟡 7.2 | 7.6 | 7.2 | 6.8 |
| Japanese | 🟠 6.6 | 7.2 | 6.6 | 6.0 |
| Hindi | 🟠 6.6 | 7.2 | 6.6 | 6.2 |
| Bengali | 🟠 6.6 | 7.2 | 6.2 | 6.6 |
| Vietnamese | 🟠 6.4 | 7.2 | 6.4 | 6.2 |
| Korean | 🟠 6.0 | 6.8 | 6.0 | 5.6 |
| Thai | 🟠 6.0 | 7.0 | 6.0 | 6.0 |
| Tamil | 🟠 5.6 | 6.4 | 5.4 | 5.2 |
Category Average: 🟠 6.5
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Hebrew | 🟠 6.2 | 7.0 | 6.2 | 6.2 |
| Arabic | 🟠 5.8 | 6.8 | 5.8 | 5.8 |
Category Average: 🟠 6.0
French - A Study in Scarlet Score: 🟢 9.0/10
View Translation
Original:
Translation:
— Vous avez été en Afghanistan, je le vois bien. — Comment diable avez-vous deviné cela ? demandai-je, stupéfait. — Peu importe, dit-il en riant sous cape. La question maintenant porte sur l’hémoglobine. Ne voyez-vous pas toute l’importance de cette découverte que j’ai faite ? — C’est intéressant, sans doute, sur le plan chimique, répondis-je, mais en pratique… — Mais enfin, mon cher, c’est la découverte médico-légale la plus pratique depuis des années ! Ne comprenez-vous pas que cela nous offre
Feedback: The translation faithfully preserves meaning and dialogue flow with excellent French phrasing. Minor stylistic consideration: 'riant sous cape' is slightly more colloquial than Holmes's typical demeanor, and 'mon cher' adds informality not present in the original, though these choices remain defensible for character voice.
Korean - Moby-Dick Score: 🟠 5.0/10
View Translation
Original:
Translation:
나를 이스마엘이라고 불러라. 몇 년 전이었는지—정확한 시간은 중요하지 않지만—주머니에 돈도 거의 없고, 육지에서 특별히 흥미를 끌 만한 것도 없던 나는 바다를 조금 돌아다니며 수면 아래의 세상을 보기로 했다. 그것은 내 spleen을 달래고 혈액 순환을 조절하는 방식이다. 입술이 엄숙해지는 느낌이 들 때마다, 내 영혼이 음울한 11월의 비가 내리는 날처럼 되기 시작하면, 나는 가능한 한 빨리 바다로 떠나야 한다고 생각한다.
Feedback: The translation captures basic meaning but has significant issues: 'spleen' is left untranslated in Korean, 'watery part of the world' becomes awkwardly 'water below the surface,' and the archaic, contemplative tone is lost in favor of more modern phrasing. The poetic melancholy of the original is diminished.
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 2 | 2.1% |
| 🟡 Good (7-8) | 57 | 60.0% |
| 🟠 Acceptable (5-6) | 36 | 37.9% |
| 🔴 Poor (3-4) | 0 | 0.0% |
| ⚫ Failed (1-2) | 0 | 0.0% |
| Metric | Value |
|---|---|
| Average Translation Time | 1952.0ms |
| Success Rate | 100.0% |