Skip to content

Avoid rebuild of GGML graph for each token#98

Merged
ikawrakow merged 1 commit intoikawrakow:mainfrom
agray3:ag_avoid_ggml_graph_rebuild
Oct 20, 2024
Merged

Avoid rebuild of GGML graph for each token#98
ikawrakow merged 1 commit intoikawrakow:mainfrom
agray3:ag_avoid_ggml_graph_rebuild

Commits

Commits on Oct 19, 2024