Skip to content

Create a forked KV IO transformer for exporting coreML Llama #7778

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
derekxu wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Create a forked KV IO transformer for exporting coreML Llama #7778

derekxu wants to merge 1 commit into from

Conversation

@derekxu
Copy link
Contributor

@derekxu derekxu commented Jan 20, 2025

Summary:
Create a forked KV IO transformer for exporting coreML Llama

  • As discussed in the group chat "
    Design: KV cache IO on ANE: llama_transformer vs. static_llama", we agreed that forking a KV IO version llama_transformer is best for code quality and coreML/ANE development purposes

Differential Revision: D68424012

@pytorch-bot
Copy link

pytorch-bot bot commented Jan 20, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/7778

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit b90b99e with merge base 948fba6 (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 20, 2025
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jan 20, 2025

This pull request was exported from Phabricator. Differential Revision: D68424012

@derekxu
Copy link
Contributor Author

derekxu commented Jan 21, 2025

@pytorchbot label "topic: not user facing"

derekxu pushed a commit to derekxu/executorch that referenced this pull request Jan 21, 2025
@facebook-github-bot
Create a forked KV IO transformer for exporting coreML Llama (pytorch…
d9e61ad 
…#7778)

Summary:

Create a forked KV IO transformer for exporting coreML Llama
- As discussed in the group chat "
Design: KV cache IO on ANE: llama_transformer vs. static_llama", we agreed that forking a KV IO version llama_transformer is best for code quality and coreML/ANE development purposes

Differential Revision: D68424012
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jan 21, 2025

This pull request was exported from Phabricator. Differential Revision: D68424012

@facebook-github-bot
Create a forked KV IO transformer for exporting coreML Llama (pytorch…
b90b99e 
…#7778)

Summary:

Create a forked KV IO transformer for exporting coreML Llama
- As discussed in the group chat "Design: KV cache IO on ANE: llama_transformer vs. static_llama", we agreed that forking a KV IO version llama_transformer is best for code quality and coreML/ANE development purposes

Differential Revision: D68424012
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jan 21, 2025

This pull request was exported from Phabricator. Differential Revision: D68424012

@github-actions
Copy link

github-actions bot commented Aug 30, 2025

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

@github-actions github-actions bot added the stale PRs inactive for over 60 days label Aug 30, 2025
@github-actions
Copy link

github-actions bot commented Oct 29, 2025

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported stale PRs inactive for over 60 days topic: not user facing

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@derekxu @facebook-github-bot