Skip to content

sampling : avoid expensive softmax during greedy sampling#9605

Merged
ggerganov merged 4 commits intomasterfrom
gg/sampling-faster-greedy
Sep 24, 2024
Merged

sampling : avoid expensive softmax during greedy sampling#9605
ggerganov merged 4 commits intomasterfrom
gg/sampling-faster-greedy

Commits

Commits on Sep 23, 2024

Commits on Sep 24, 2024