FLLM on static llama

[shewu-quic]

Summary:

repro command

host_id=xxx
device_id=yyy
soc=SSG2115P



mode=prefill
prefill_seq_len=65
kv_seq_len=512

prefix=${mode}_PSL_${prefill_seq_len}_KVL_${kv_seq_len}_${compare}
art=${prefix}_${host_id}_${device_id}_${soc}

python examples/qualcomm/oss_scripts/llama3_2/llama.py -a ./${art} \
 -b build-android -H ${host_id} -s ${device_id} -m ${soc} \
 --checkpoint ../FLLM/consolidated.00.pth \
 --params ../FLLM/params.json \
 --tokenizer_model ../FLLM/tokenizer.model \
 --prompt "<|begin_of_text|>Classify<|eot_id|>#user: how warm is it tonight mumbai in degree c<|eot_id|>!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!" \
 --temperature 0 \
 --model_size 1B \
 --model_mode ${mode} \
 --kv_seq_len ${kv_seq_len} \
  --ptq 16a4w \
 --prefill_seq_len ${prefill_seq_len} \
 --model_arch_device cpu \
 2>&1 | tee ../export_{$art}_log.txt

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/7489

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures

As of commit c7e4671 with merge base f370e78 ():

NEW FAILURES - The following jobs have failed:

• Check Labels / Check labels (gh)
  RuntimeError: Error checking labels: PR does not have required labels
• Lint / lintrunner / linux-job (gh)
  >>> Lint for examples/qualcomm/oss_scripts/llama3_2/runner/runner.cpp:
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 50c80c536d7c25721e5ab951788e5b81b8a3dfb51e231e936d1d45fec4b29a24 /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t bf0b98548780c53a5e9dcdedb8c2c3373c9515dd88888d43af68dd7562c1f659 /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your changes are user facing and intended to be a part of release notes, please use a label starting with release notes:.

If not, please add the topic: not user facing label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "topic: not user facing"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.