Perplexity vs Size Graphs for the recent quants (Deepseek-R1, Kimi-K2, Chimera etc.) #715

magikRUKKOLA · 2025-08-21T14:17:19Z

magikRUKKOLA
Aug 21, 2025

GRAPHS:

DATA SOURCES:

{
  "title": "DeepSeek-R1-0528 (671B) Quantization Analysis",
  "subtitle": "Lower perplexity = Better performance",
  "model_parameters": 671000000000,
  "data": [
    {"name": "IQ1_S_R4", "bpw": 1.664, "ppl": 4.8831, "url": "https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF/tree/main/IQ1_S_R4"},
    {"name": "THIREUS-1.9364", "bpw": 1.9364, "ppl": 4.3533, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-1.9364bpw-4.3533ppl.151GB-GGUF_11GB-GPU_140GB-CPU.3c88ec6_9fd615d.recipe"},
    {"name": "IQ2_KT", "bpw": 2.514, "ppl": 3.6378},
    {"name": "THIREUS-2.7840", "bpw": 2.7840, "ppl": 3.4341, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-2.7840bpw-3.4341ppl.217GB-GGUF_14GB-GPU_203GB-CPU.3c88ec6_02247be.recipe"},
    {"name": "IQ2_K_R4", "bpw": 2.799, "ppl": 3.5069, "url": "https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF/tree/main/IQ2_K_R4"},
    {"name": "JWNoctis/R1-0528/IQ2_KL", "bpw": 2.930, "ppl": 3.4379, "url": "https://forum.level1techs.com/t/deepseek-deep-dive-r1-at-home/225826/354"},
    {"name": "UD_Q2_K_XL", "bpw": 2.994, "ppl": 3.5278, "url": "https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF/tree/main/UD-Q2_K_XL"},
    {"name": "THIREUS-3.1027", "bpw": 3.1027, "ppl": 3.3372, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.1027bpw-3.3372ppl.242GB-GGUF_11GB-GPU_231GB-CPU.3c88ec6_adc8101.recipe"},
    {"name": "THIREUS-3.1446", "bpw": 3.1446, "ppl": 3.3257, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.1446bpw-3.3257ppl.246GB-GGUF_15GB-GPU_231GB-CPU.3c88ec6_7d1efe1.recipe"},
    {"name": "THIREUS-3.1447", "bpw": 3.1447, "ppl": 3.3269, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.1447bpw-3.3269ppl.246GB-GGUF_15GB-GPU_231GB-CPU.3c88ec6_4b1254a.recipe"},
    {"name": "THIREUS-3.1525", "bpw": 3.1525, "ppl": 3.3251, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.1525bpw-3.3251ppl.246GB-GGUF_15GB-GPU_231GB-CPU.3c88ec6_5a3fc0f.recipe"},
    {"name": "THIREUS-3.1740", "bpw": 3.1740, "ppl": 3.3253, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.1740bpw-3.3253ppl.248GB-GGUF_17GB-GPU_231GB-CPU.3c88ec6_6cf3a72.recipe"},
    {"name": "THIREUS-3.1858", "bpw": 3.1858, "ppl": 3.3261, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.1858bpw-3.3261ppl.249GB-GGUF_18GB-GPU_231GB-CPU.3c88ec6_027b7ff.recipe"},
    {"name": "THIREUS-3.2564", "bpw": 3.2564, "ppl": 3.2985, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.2564bpw-3.2985ppl.254GB-GGUF_15GB-GPU_239GB-CPU.3c88ec6_7c0be1e.recipe"},
    {"name": "IQ3_KT", "bpw": 3.483, "ppl": 3.3056, "url": "https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF/tree/main/IQ3_KT"},
    {"name": "THIREUS-3.5652", "bpw": 3.5652, "ppl": 3.2734, "url": "https://github.com/Thireus/GGUF-Tool-Suite/blob/main/recipe_examples/DeepSeek-R1-0528.THIREUS-3.5652bpw-3.2734ppl.278GB-GGUF_14GB-GPU_264GB-CPU.3c88ec6_9b5660b.recipe"},
    {"name": "IQ3_KS", "bpw": 3.598, "ppl": 3.2991, "url": "https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF/tree/main/IQ3_KS"},
    {"name": "THIREUS-3.6766", "bpw": 3.6766, "ppl": 3.2741, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13781700"},
    {"name": "IQ3_K_R4", "bpw": 3.847, "ppl": 3.2730, "url": "https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF/tree/main/IQ3_K_R4"},
    {"name": "THIREUS-3.976", "bpw": 3.976, "ppl": 3.2452, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13798329"},
    {"name": "IQ4_XS (unsloth)", "bpw": 4.2683, "ppl": 3.2598, "url": "https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF/tree/main/IQ4_XS"},
    {"name": "q4_0", "bpw": 4.508, "ppl": 3.2895, "url": "https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF/tree/main/Q4_0"},
    {"name": "UD_Q4_K_XL", "bpw": 4.578, "ppl": 3.2483, "url": "https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF/tree/main/UD-Q4_K_XL"},
    {"name": "IQ4_KS_R4", "bpw": 4.701, "ppl": 3.2286, "url": "https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF/tree/main/IQ4_KS_R4"},
    {"name": "DQ4_K_R4", "bpw": 5.289, "ppl": 3.2276, "url": "https://huggingface.co/anikifoss/DeepSeek-R1-0528-DQ4_K_R4"},
    {"name": "THIREUS-6.2478", "bpw": 6.2478, "ppl": 3.2240, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13781560"},
    {"name": "THIREUS-6.4296", "bpw": 6.4296, "ppl": 3.2231, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/718#discussioncomment-14193821"},
    {"name": "THIREUS-6.5522", "bpw": 6.5522, "ppl": 3.2227, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/718#discussioncomment-14193821"},
    {"name": "Q8_0", "bpw": 8.5259260, "ppl": 3.2130, "url": "https://huggingface.co/unsloth/DeepSeek-R1-0528-GGUF/tree/main/Q8_0"}
  ]
}
{
  "title": "DeepSeek-V3.1 (671B) Quantization Analysis",
  "subtitle": "Lower perplexity = Better performance",
  "model_parameters": 671000000000,
  "data": [
  { "name": "IQ1_S", "bpw": 1.710, "ppl": 5.3113, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ1_S" },
  { "name": "IQ1_KT", "bpw": 1.984, "ppl": 4.3987, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ1_KT" },
  { "name": "IQ2_KS", "bpw": 2.472, "ppl": 3.9583, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ2_KS" },
  { "name": "IQ2_KT", "bpw": 2.619, "ppl": 3.8109, "url": "" },
  { "name": "IQ2_KL", "bpw": 2.960, "ppl": 3.6312, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ2_KL" },
  { "name": "IQ3_KS", "bpw": 3.551, "ppl": 3.4534, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ3_KS" },
  { "name": "IQ3_K", "bpw": 3.753, "ppl": 3.4260, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ3_K" },
  { "name": "smol-IQ4_KSS", "bpw": 4.080, "ppl": 3.3898, "url": "" },
  { "name": "IQ4_KSS", "bpw": 4.162, "ppl": 3.3887, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ4_KSS" },
  { "name": "Q4_0", "bpw": 4.507, "ppl": 3.4277, "url": "" },
  { "name": "UD-Q4_K_XL", "bpw": 4.507, "ppl": 3.4013, "url": "https://huggingface.co/unsloth/DeepSeek-V3.1-GGUF/tree/main/UD-Q4_K_XL" },
  { "name": "IQ4_KS", "bpw": 4.649, "ppl": 3.3806, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ4_KS" },
  { "name": "IQ4_K", "bpw": 4.925, "ppl": 3.3715, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ4_K" },
  { "name": "IQ5_K", "bpw": 5.944, "ppl": 3.3550, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/IQ5_K" },
  { "name": "Q8_0", "bpw": 8.504, "ppl": 3.3473, "url": "https://huggingface.co/ubergarm/DeepSeek-V3.1-GGUF/tree/main/Q8_0" },
  { "name": "BF16", "bpw": 16.003, "ppl": 3.3469, "url": "" }
  ]
}
{
  "title": "DeepSeek-TNG-R1T2-Chimera (671B) Quantization Analysis",
  "subtitle": "Lower perplexity = Better performance",
  "model_parameters": 671000000000,
  "data": [
    {"name": "IQ1_S", "bpw": 1.699, "ppl": 4.9878, "url": "https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF/tree/main/IQ1_S"},
    {"name": "THIREUS-1.6693", "bpw": 1.6693, "ppl": 4.9676, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13883488"},
    {"name": "THIREUS-1.7067", "bpw": 1.7067, "ppl": 4.9199, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13914222"},
    {"name": "THIREUS-2.0622", "bpw": 2.0622, "ppl": 4.0622, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13914222"},
    {"name": "THIREUS-2.1572", "bpw": 2.1572, "ppl": 4.0228, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13883488"},
    {"name": "IQ2_XSS", "bpw": 2.168, "ppl": 4.0078, "url": "https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF/tree/main/IQ2_XSS"},
    {"name": "IQ2_KT", "bpw": 2.188, "ppl": 3.8887, "url": "https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF/tree/main/IQ2_KT"},
    {"name": "THIREUS-2.5961", "bpw": 2.5961, "ppl": 3.6768, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13883488"},
    {"name": "IQ2_KS", "bpw": 2.602, "ppl": 3.6254, "url": "https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF/tree/main/IQ2_KS"},
    {"name": "THIREUS-2.6261", "bpw": 2.6261, "ppl": 3.5627, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13914222"},
    {"name": "THIREUS-3.5753", "bpw": 3.5753, "ppl": 3.3187, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13883488"},
    {"name": "THIREUS-3.5858", "bpw": 3.5858, "ppl": 3.3063, "url": "https://github.com/ikawrakow/ik_llama.cpp/discussions/477#discussioncomment-13914222"},
    {"name": "IQ3_KS", "bpw": 3.598, "ppl": 3.3167, "url": "https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF/tree/main/IQ3_KS"}
  ]
}
{
  "title": "Kimi-K2-Instruct (1026B) Quantization Analysis",
  "subtitle": "Lower perplexity = Better performance",
  "model_parameters": 1026000000000,
  "data": [
    {"name": "smol-IQ1_KT", "bpw": 1.792, "ppl": 4.3623, "url": "https://huggingface.co/ubergarm/Kimi-K2-Instruct-GGUF"},
    {"name": "IQ1_KT", "bpw": 1.915, "ppl": 4.1310, "url": "https://huggingface.co/ubergarm/Kimi-K2-Instruct-GGUF"},
    {"name": "UD-IQ1_S", "bpw": 2.192, "ppl": 4.3331, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/UD-IQ1_S"},
    {"name": "IQ2_KS", "bpw": 2.398, "ppl": 3.7922, "url": "https://huggingface.co/ubergarm/Kimi-K2-Instruct-GGUF/tree/main/IQ2_KS"},
    {"name": "UD-IQ2_XXS", "bpw": 2.558, "ppl": 3.5258, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/UD-IQ2_XXS"},
    {"name": "IQ2_KL", "bpw": 2.892, "ppl": 3.2741, "url": "https://huggingface.co/ubergarm/Kimi-K2-Instruct-GGUF/tree/main/IQ2_KL"},
    {"name": "Q2_K", "bpw": 2.906, "ppl": 4.9829, "url": "https://huggingface.co/gabriellarson/Kimi-K2-Instruct-GGUF"},
    {"name": "bigattnshexpdense-IQ2_KL", "bpw": 2.923, "ppl": 3.1813, "url": "full q8_0 attn/shexp/blk.0.ffn"},
    {"name": "chonk-IQ2_KL", "bpw": 3.057, "ppl": 3.2095, "url": "blk.(1|2|3|4|5|6|59|60).ffn_down_exps.weight=iq4_ks and blk.(1|2|3|4|5|6|59|60).ffn_(gate|up)_exps.weight=iq4_kss"},
    {"name": "UD-IQ3_XXS", "bpw": 3.247, "ppl": 3.1467, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/UD-IQ3_XXS"},
    {"name": "UD-Q3_K_XL", "bpw": 3.524, "ppl": 3.2695, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/UD-Q3_K_XL"},
    {"name": "IQ3_KS", "bpw": 3.573, "ppl": 3.0367, "url": "https://huggingface.co/ubergarm/Kimi-K2-Instruct-GGUF/tree/main/IQ3_KS"},
    {"name": "UD-Q4_K_XL", "bpw": 4.581, "ppl": 3.0612, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/UD-Q4_K_XL"},
    {"name": "IQ4_XS(unsloth)", "bpw": 4.58, "ppl": 2.9812, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/IQ4_XS"},
    {"name": "IQ4_KS", "bpw": 4.604, "ppl": 3.0438, "url": "https://huggingface.co/ubergarm/Kimi-K2-Instruct-GGUF/tree/main/IQ4_KS"},
    {"name": "DQ4_K", "bpw": 5.229, "ppl": 2.9691, "url": "https://huggingface.co/anikifoss/Kimi-K2-Instruct-DQ4_K"},
    {"name": "Q8_0", "bpw": 8.504, "ppl": 2.9507, "url": "https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main/Q8_0"}
  ]
}

CODE: #477 (comment)

ikawrakow · 2025-08-21T14:34:13Z

ikawrakow
Aug 21, 2025
Maintainer

@magikRUKKOLA Thank you for these graphs, very useful!

Can one do something to improve discoverability? I personally find it a bit hard to find which point corresponds to which quantization.

2 replies

magikRUKKOLA Aug 21, 2025
Author

@magikRUKKOLA Thank you for these graphs, very useful!

Can one do something to improve discoverability? I personally find it a bit hard to find which point corresponds to which quantization.

SVG suppose to support xlink namespace for the hyperlinks. But I am not sure. I have to check.

magikRUKKOLA Aug 24, 2025
Author

@ikawrakow

As related to the discoverability. I drew some opaque lines (dashed lines for non-pareto quants) so it should be easier to trace. Not sure why the hovering effect doesn't work (in github) though.

ubergarm · 2025-08-24T18:03:16Z

ubergarm
Aug 24, 2025

Thanks @magikRUKKOLA for putting these together. Always interesting to see which quantization types are performing well on some of these big models.

I just added a few more data points to my DeepSeek-V3.1 collection. The IQ4_KSS is doing unreasonably well again right around 4.0BPW. I went back and re-read this earlier discussion on QAT and IQ4_KS here: #359 (comment) and speculating wildly if it could have anything to do with ~4.0BPW being a "sweet spot" in the size vs perplexity trade-off curve.

👈 json data

[
  {
    "name": "BF16",
    "ppl": "3.3469 +/- 0.01936",
    "size": 1250.084,
    "bpw": 16.003,
    "legend": "pure"
  },
  {
    "name": "Q8_0",
    "ppl": "3.3473 +/- 0.01935",
    "size": 664.295,
    "bpw": 8.504,
    "legend": "pure",
    "skip": true
  },
  {
    "name": "IQ5_K",
    "ppl": "3.3550 +/- 0.01942",
    "size": 465.075,
    "bpw": 5.944,
    "legend": "ubergarm"
  },
  {
    "name": "IQ4_K",
    "ppl": "3.3715 +/- 0.01956",
    "size": 384.765,
    "bpw": 4.925,
    "legend": "ubergarm",
    "comment": ""
  },
  {
    "name": "IQ4_KS",
    "ppl": "3.3806 +/- 0.01966",
    "size": 363.151,
    "bpw": 4.649,
    "legend": "ubergarm",
    "comment": ""
  },
  {
    "name": "Q4_0",
    "ppl": "3.4277 +/- 0.02000",
    "size": 352.096,
    "bpw": 4.507,
    "legend": "pure",
    "comment": "q4_K embd, q6_K head"
  },
  {
    "name": "IQ4_KSS",
    "ppl": "3.3887 +/- 0.01968",
    "size": 325.088,
    "bpw": 4.162,
    "legend": "ubergarm",
    "comment": ""
  },
  {
    "name": "smol-IQ4_KSS",
    "ppl": "3.3898 +/- 0.01964",
    "size": 318.745,
    "bpw": 4.080,
    "legend": "ubergarm",
    "comment": ""
  },
  {
    "name": "IQ3_K",
    "ppl": "3.4260 +/- 0.01995",
    "size": 293.177,
    "bpw": 3.753,
    "legend": "ubergarm",
    "comment": "PR624 ik/quantization_tweaks"
  },
  {
    "name": "IQ3_KS",
    "ppl": "3.4534 +/- 0.02019",
    "size": 277.397,
    "bpw": 3.551,
    "legend": "ubergarm",
    "comment": "PR624 ik/quantization_tweaks"
  },
  {
    "name": "IQ2_KL",
    "ppl": "3.6312 +/- 0.02161",
    "size": 231.206,
    "bpw": 2.960,
    "legend": "ubergarm",
    "comment": "PR624 ik/quantization_tweaks"
  },
  {
    "name": "IQ2_KT",
    "ppl": "3.8109 +/- 0.02294",
    "size": 204.592,
    "bpw": 2.619,
    "legend": "ubergarm",
    "comment": "PR624 ik/quantization_tweaks + PR to fix KT quantization"
  },
  {
    "name": "IQ2_KS",
    "ppl": "3.9583 +/- 0.02433",
    "size": 193.144,
    "bpw": 2.472,
    "legend": "ubergarm",
    "comment": "PR624 ik/quantization_tweaks"
  },
  {
    "name": "IQ1_KT",
    "ppl": "4.3987 +/- 0.02786",
    "size": 154.968,
    "bpw": 1.984,
    "legend": "ubergarm",
    "comment": ""
  },
  {
    "name": "IQ1_S",
    "ppl": "5.3113 +/- 0.03507",
    "size": 133.610,
    "bpw": 1.710,
    "legend": "ubergarm",
    "comment": ""
  }
]

0 replies

oovloveme · 2025-08-29T01:04:16Z

oovloveme
Aug 29, 2025

Add my test result :
DeepSeek-V3.1-UD-Q4_K_XL : PPL = 3.4013 +/- 0.01980

Kimi-K2-Instruct-UD-Q3_K_XL : PPL = 3.2330 +/- 0.01668
Kimi-K2-Instruct-IQ3_KS : PPL = 3.0275 +/- 0.01520
Kimi-K2-Instruct-IQ4_XS(Unsloth) : PPL = 2.9812 +/- 0.01485

3 replies

magikRUKKOLA Aug 30, 2025
Author

Add my test result : DeepSeek-V3.1-UD-Q4_K_XL : PPL = 3.4013 +/- 0.01980

Kimi-K2-Instruct-UD-Q3_K_XL : PPL = 3.2330 +/- 0.01668 Kimi-K2-Instruct-IQ3_KS : PPL = 3.0275 +/- 0.01520 Kimi-K2-Instruct-IQ4_XS(Unsloth) : PPL = 2.9812 +/- 0.01485

DeepSeek-V3.1-UD-Q4_K_XL and Kimi-K2-Instruct-IQ4_XS(Unsloth) are added. The rest already were in the graphs though with slightly different PPLs. So the main takeaway is that we should also somehow specify the version of the ik_llama.cpp -- it seems that the way different versions can have slightly different ppls due to the changes in the code, that is, the way the quants are getting processed. see here: #624 (comment)

Also, for the future submissions plz add the BPW parameter if you can. Its written in the logs of the llama-perplexity. I calculated the BPW like this:

echo "scale=8;(452*1000^3*8)/1026000000000"|bc
3.52436647

where 452 is taken from the huggingface.com info page. Hopefully the calculations are correct.

saood06 Aug 30, 2025
Collaborator

Kimi-K2-Instruct-IQ4_XS(Unsloth) are added.

You label it as IQ4_KS not IQ4_XS on the graph.

magikRUKKOLA Aug 30, 2025
Author

@saood06

You label it as IQ4_KS not IQ4_XS on the graph.

Good catch! :D

Perplexity vs Size Graphs for the recent quants (Deepseek-R1, Kimi-K2, Chimera etc.) #715

Uh oh!

Uh oh!

magikRUKKOLA Aug 21, 2025

Replies: 3 comments · 5 replies

Uh oh!

ikawrakow Aug 21, 2025 Maintainer

Uh oh!

magikRUKKOLA Aug 21, 2025 Author

Uh oh!

magikRUKKOLA Aug 24, 2025 Author

Uh oh!

ubergarm Aug 24, 2025

Uh oh!

Uh oh!

oovloveme Aug 29, 2025

Uh oh!

magikRUKKOLA Aug 30, 2025 Author

Uh oh!

saood06 Aug 30, 2025 Collaborator

Uh oh!

magikRUKKOLA Aug 30, 2025 Author

magikRUKKOLA
Aug 21, 2025

Replies: 3 comments 5 replies

ikawrakow
Aug 21, 2025
Maintainer

magikRUKKOLA Aug 21, 2025
Author

magikRUKKOLA Aug 24, 2025
Author

ubergarm
Aug 24, 2025

oovloveme
Aug 29, 2025

magikRUKKOLA Aug 30, 2025
Author

saood06 Aug 30, 2025
Collaborator

magikRUKKOLA Aug 30, 2025
Author