Unable to inference on Quantized 70B Model using llama.cpp

[vatsarishabh22]

Got error :
error loading model: llama.cpp: tensor 'layers.0.attention.wk.weight' has wrong shape; expected 8192 * 8192, got 8192 * 1024

I am using ubuntu linux

[klosax]

Use parameter -gqa 8 for 70b models to work.