Serialize tensors using int8 views#16866

Merged

njhill merged 10 commits intovllm-project:mainfrom

p88h:serialize-tensors

Apr 19, 2025

Commits on Apr 18, 2025

Serialize tensors using int8 views
p88h
committed
Formatting
p88h
committed
Apply suggestions from code review

p88h
and
njhill
committed
add more bf16 tests from #16860
p88h
committed
style
p88h
committed
Update vllm/v1/serial_utils.py

p88h
and
njhill
committed
Apply suggestions from code review

p88h
and
njhill
committed
Comments
p88h
committed
fix typo
p88h
committed

Commits on Apr 19, 2025

Skip copy ndarray in the decode path
p88h
committed