You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
SUMMARY:
In response to
#1688, add an
awq_asym lm-eval test config.
TEST PLAN:
```
export CADENCE=weekly
export TEST_DATA_FILE=tests/lmeval/configs/w4a16_awq_asym.yaml
python -m pytest tests/lmeval/test_lmeval.py::TestLMEval::test_lm_eval -v
```
MISC:
As Llama is a gated model, I'm using a local model path instead of
meta-llama/Meta-Llama-3-8B-Instruct during local testing. I'm not sure
if this might affect the test flow / accuracy. It would be great if you
could help me verify it. That's also why I've marked it as WIP.
---------
Signed-off-by: aladerran <[email protected]>
Co-authored-by: Dipika Sikka <[email protected]>
0 commit comments