merge from upstream#59

Merged

l3utterfly merged 46 commits intolayla-buildfrom

Mar 26, 2025

Commits on Mar 18, 2025

Commits on Mar 19, 2025

vulkan: Submit once enough matmul work has been recorded (#12406)
jeffbolznv
authored
convert : Support chat_template.json (#12460)
CISC
authored
llama : add support for GPT2, Bloom and CodeShell tied word embeddings (#12456)
CISC
authored
Fix visionOS build and add CI (#12415)

guusw
and
sinkingsugar
authored
vulkan: optimize iq1 coopmat2 dequant functions (#12427)
jeffbolznv
authored
CUDA: Improve flash decoding kernel GPU occupancy for BS=1 case (#12183)

gaugarg-nv
and
JohannesGaessler
authored
context : clear sets containing encoder output sequence ids before storing new values (#12470)

fairydreaming
and
sszymczy
authored

Commits on Mar 21, 2025

Commits on Mar 23, 2025

Commits on Mar 24, 2025

Commits on Mar 25, 2025