to benchmark chunked long context prefill

[kimishpatel]

Stack from ghstack (oldest at bottom):

• -> to benchmark chunked long context prefill #9779

Enable perfilling large context by chunking the input

Differential Revision: D71833061

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/9779

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• ROCm MI2xx CI/CD workflows failing due to : download from https://api.github.com/repos/pytorch/pytorch timed out.

❌ 14 New Failures, 1 Cancelled Job

As of commit 64d60bb with merge base 2aa7748 ():

NEW FAILURES - The following jobs have failed:

• Build Linux Wheels / pytorch/executorch / build-manywheel-py3_10-cpu (gh)
• Build Linux Wheels / pytorch/executorch / upload / upload-manywheel-py3_10-cpu (gh)
  Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_x86_64
• Build macOS Wheels / pytorch/executorch / build-wheel-py3_10-cpu (gh)
  Process completed with exit code 1.
• Build macOS Wheels / pytorch/executorch / upload / upload-wheel-py3_10-cpu (gh)
  Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_
• Lint / lintrunner / linux-job (gh)
  >>> Lint for examples/models/llama/runner/runner.cpp:
• Propose to merge ghstack orig PRs to main / Try to create a PR with ghstack /orig branch (gh)
  Process completed with exit code 1.
• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t dd43f3bbcc7869d3d2941d92fa3397e676fa55671afee2edec22980d7dc2622a /exec failed with exit code 1
• pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t c3109ba03eb60644a8b860331341de0c97fce74eae7db1cba9057bf29a291ae6 /exec failed with exit code 1
• pull / test-moshi-linux / linux-job (gh)
  RuntimeError: Command docker exec -t b8434b078ced8789f47008a56af81b18152fc141d47a4f8278447ddc82a5d080 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  RuntimeError: Command docker exec -t a4cb9bf42ffecaa9c4dc56073fbd6a60376112a4b77e08634ccb626aefa70f5b /exec failed with exit code 1
• pull / unittest / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / unittest-arm / linux-job (gh)
  RuntimeError: Command docker exec -t b0ca58b2cc9fdbb680e1581f155a97330aa50a2d290a97952f832afc2dd91631 /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 2dbf952d22368dba67f34d43ae9b65ba8c9019042a48021a798a239f0f570026 /exec failed with exit code 1
• pull / unittest-editable / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

CANCELLED JOB - The following job was cancelled. Please retry:

• pull / test-static-llama-qnn-linux / linux-job (gh)
  ##[error]The operation was canceled.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D71833061

[github-actions]

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.