-
Notifications
You must be signed in to change notification settings - Fork 722
Closed
Labels
actionableItems in the backlog waiting for an appropriate impl/fixItems in the backlog waiting for an appropriate impl/fixmodule: llmIssues related to LLM examples and apps, and to the extensions/llm/ codeIssues related to LLM examples and apps, and to the extensions/llm/ codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
Description
🐛 Describe the bug
Between Llama 3.1 and 3.2, rope_scale factor had increased from 8 to 32.
https://huggingface.co/.../Llama-3.2-3B.../discussions/1
https://huggingface.co/.../f6dcb8adea08358576f9a68d351035...
But our code is still hard-coded to https://github.com/pytorch/executorch/blob/main/examples/models/llama/rope.py#L20
Versions
N/A
Metadata
Metadata
Assignees
Labels
actionableItems in the backlog waiting for an appropriate impl/fixItems in the backlog waiting for an appropriate impl/fixmodule: llmIssues related to LLM examples and apps, and to the extensions/llm/ codeIssues related to LLM examples and apps, and to the extensions/llm/ codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module