-
-
Notifications
You must be signed in to change notification settings - Fork 69
Model llama3 1 8b
Ollama Model ID: llama3.1:8b
| Metric | Value |
|---|---|
| Average Score | 🔴 4.2/10 |
| Accuracy | 4.9/10 |
| Fluency | 4.2/10 |
| Style | 3.8/10 |
| Languages Tested | 19 |
| Total Translations | 95 |
| Best Language | Portuguese (6.4) |
| Worst Language | Bengali (1.2) |
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Portuguese | 🟠 6.4 | 6.8 | 6.4 | 6.0 |
| 2 | Spanish | 🟠 6.2 | 6.8 | 6.2 | 5.6 |
| 3 | Italian | 🟠 6.0 | 6.4 | 6.0 | 5.8 |
| 4 | German | 🟠 5.6 | 6.6 | 5.6 | 5.6 |
| 5 | Vietnamese | 🟠 5.4 | 6.2 | 5.4 | 5.0 |
| 6 | French | 🟠 5.2 | 6.0 | 5.2 | 5.2 |
| 7 | Chinese (Simplified) | 🟠 5.0 | 5.8 | 5.0 | 4.6 |
| 8 | Polish | 🔴 4.8 | 5.6 | 4.8 | 4.2 |
| 9 | Russian | 🔴 4.6 | 5.6 | 4.6 | 4.4 |
| 10 | Chinese (Traditional) | 🔴 4.4 | 5.0 | 4.8 | 3.6 |
View all 19 languages
| Rank | Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|---|
| 1 | Portuguese | 🟠 6.4 | 6.8 | 6.4 | 6.0 |
| 2 | Spanish | 🟠 6.2 | 6.8 | 6.2 | 5.6 |
| 3 | Italian | 🟠 6.0 | 6.4 | 6.0 | 5.8 |
| 4 | German | 🟠 5.6 | 6.6 | 5.6 | 5.6 |
| 5 | Vietnamese | 🟠 5.4 | 6.2 | 5.4 | 5.0 |
| 6 | French | 🟠 5.2 | 6.0 | 5.2 | 5.2 |
| 7 | Chinese (Simplified) | 🟠 5.0 | 5.8 | 5.0 | 4.6 |
| 8 | Polish | 🔴 4.8 | 5.6 | 4.8 | 4.2 |
| 9 | Russian | 🔴 4.6 | 5.6 | 4.6 | 4.4 |
| 10 | Chinese (Traditional) | 🔴 4.4 | 5.0 | 4.8 | 3.6 |
| 11 | Thai | 🔴 4.4 | 5.2 | 4.4 | 3.8 |
| 12 | Ukrainian | 🔴 4.0 | 5.0 | 4.0 | 3.8 |
| 13 | Hindi | 🔴 3.8 | 4.8 | 3.8 | 3.4 |
| 14 | Japanese | 🔴 3.4 | 4.0 | 3.6 | 2.8 |
| 15 | Arabic | 🔴 3.0 | 3.8 | 3.0 | 2.4 |
| 16 | Korean | ⚫ 2.2 | 3.2 | 2.2 | 2.0 |
| 17 | Hebrew | ⚫ 2.2 | 3.0 | 2.2 | 2.0 |
| 18 | Tamil | ⚫ 1.4 | 2.0 | 1.4 | 1.2 |
| 19 | Bengali | ⚫ 1.2 | 2.0 | 1.2 | 1.2 |
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Portuguese | 🟠 6.4 | 6.8 | 6.4 | 6.0 |
| Spanish | 🟠 6.2 | 6.8 | 6.2 | 5.6 |
| Italian | 🟠 6.0 | 6.4 | 6.0 | 5.8 |
| German | 🟠 5.6 | 6.6 | 5.6 | 5.6 |
| French | 🟠 5.2 | 6.0 | 5.2 | 5.2 |
| Polish | 🔴 4.8 | 5.6 | 4.8 | 4.2 |
Category Average: 🟠 5.7
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Vietnamese | 🟠 5.4 | 6.2 | 5.4 | 5.0 |
| Chinese (Simplified) | 🟠 5.0 | 5.8 | 5.0 | 4.6 |
| Chinese (Traditional) | 🔴 4.4 | 5.0 | 4.8 | 3.6 |
| Thai | 🔴 4.4 | 5.2 | 4.4 | 3.8 |
| Hindi | 🔴 3.8 | 4.8 | 3.8 | 3.4 |
| Japanese | 🔴 3.4 | 4.0 | 3.6 | 2.8 |
| Korean | ⚫ 2.2 | 3.2 | 2.2 | 2.0 |
| Tamil | ⚫ 1.4 | 2.0 | 1.4 | 1.2 |
| Bengali | ⚫ 1.2 | 2.0 | 1.2 | 1.2 |
Category Average: 🔴 3.5
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Russian | 🔴 4.6 | 5.6 | 4.6 | 4.4 |
| Ukrainian | 🔴 4.0 | 5.0 | 4.0 | 3.8 |
Category Average: 🔴 4.3
| Language | Overall | Accuracy | Fluency | Style |
|---|---|---|---|---|
| Arabic | 🔴 3.0 | 3.8 | 3.0 | 2.4 |
| Hebrew | ⚫ 2.2 | 3.0 | 2.2 | 2.0 |
Category Average: ⚫ 2.6
French - Walden Score: 🟡 8.0/10
View Translation
Original:
Translation:
J'ai voulu aller dans la forêt parce que je désirais vivre délibérément, affronter uniquement les faits essentiels de la vie et voir si je pouvais apprendre ce qu'elle avait à m'enseigner, et ne pas, quand je viendrais à mourir, découvrir que je n'avais pas vécu. Je ne souhaitais pas vivre autre chose que la vie elle-même ; car vivre est si cher ; ni pratiquer la résignation, sauf s'il était tout à fait nécessaire. J'aurais voulu vivre en profondeur et absorber toute la saveur de la vie.
Feedback: The translation faithfully preserves Thoreau's philosophical meaning and existential urgency with strong equivalents like 'vivre délibérément' and 'absorber toute la saveur de la vie.' Minor fluency issues exist ('J'ai voulu aller' is slightly awkward; 'quand je viendrais à mourir' is archaic) and the repetition of 'vie/vivre' could be smoother, but the contemplative tone and intellectual rigor are well maintained.
Korean - Moby-Dick Score: ⚫ 1.0/10
View Translation
Original:
Translation:
내 이름은 이슈마엘입니다. 어느 날 갑자기—정확한 날짜는 물고—are 무작위로 생각하겠습니다—내 가방에 돈이 조금있거나도되지요—지금은 제게 해시 моря의 부분을 볼래 있습니다. 그것은 내게가있는 방법으로 고혈압을 달리하고 순환을 조절합니다. 내 자신이 구역질하는 표정일 때마다; 항상 내 영혼에 쌀쌀한 11월이면, 나는 빨리 바다로 가는 것이고 싶습니다.
Feedback: This translation is severely flawed with numerous errors including incomplete sentences, mixed languages (Russian 'моря'), grammatical incoherence, and fundamental meaning distortions that render it nearly incomprehensible. The archaic literary style is completely lost, and basic semantic content is corrupted throughout.
| Score Range | Count | Percentage |
|---|---|---|
| 🟢 Excellent (9-10) | 0 | 0.0% |
| 🟡 Good (7-8) | 7 | 7.4% |
| 🟠 Acceptable (5-6) | 38 | 40.0% |
| 🔴 Poor (3-4) | 26 | 27.4% |
| ⚫ Failed (1-2) | 24 | 25.3% |
| Metric | Value |
|---|---|
| Average Translation Time | 8068.0ms |
| Success Rate | 100.0% |