Skip to content

[LLM Runner] Store grammar/schema in PTE via NamedData #19477

Open
Open
[LLM Runner] Store grammar/schema in PTE via NamedData#19477
Assignees
kirklandsign
Labels
module: llmIssues related to LLM examples and apps, and to the extensions/llm/ codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
@kirklandsign

Description

@kirklandsign
kirklandsign
opened on May 11, 2026

Embed grammar in .pte via NamedData. add_metadata(grammar=..., grammar_type=...) on export side, runner reads at load time. GenerationConfig overrides. Depends on: metadata NamedData integration (D104322796).

cc @larryliu0820 @mergennachin @cccclai @helunwencser @jackzhxng

Metadata

Metadata

Assignees

Labels

module: llmIssues related to LLM examples and apps, and to the extensions/llm/ codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

ExecuTorch Core

Status

To triage

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions