Skip to content

Releases: MekayelAnik/vllm-cpu

vLLM CPU v0.15.0

29 Jan 10:56
@github-actions github-actions
v0.15.0
0e626ed

Choose a tag to compare

View all tags
vLLM CPU v0.15.0 Latest
Latest

vLLM CPU Wheels

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512 Skylake-X+ pip install "vllm-cpu-avx512 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu_avx512-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512vnni Cascade Lake+ pip install "vllm-cpu-avx512vnni @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu_avx512vnni-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512bf16 Cooper Lake+ pip install "vllm-cpu-avx512bf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu_avx512bf16-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-amxbf16 Sapphire Rapids+ pip install "vllm-cpu-amxbf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu_amxbf16-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu (ARM64) ARM64/AArch64 pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.15.0/vllm_cpu-0.15.0-cp312-cp312-manylinux_2_28_aarch64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Assets 25

vLLM CPU v0.14.1

24 Jan 21:31
@github-actions github-actions
v0.14.1
0e626ed

Choose a tag to compare

View all tags
vLLM CPU v0.14.1

vLLM CPU Wheels

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512 Skylake-X+ pip install "vllm-cpu-avx512 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu_avx512-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512vnni Cascade Lake+ pip install "vllm-cpu-avx512vnni @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu_avx512vnni-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512bf16 Cooper Lake+ pip install "vllm-cpu-avx512bf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu_avx512bf16-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-amxbf16 Sapphire Rapids+ pip install "vllm-cpu-amxbf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu_amxbf16-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu (ARM64) ARM64/AArch64 pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.1/vllm_cpu-0.14.1-cp312-cp312-manylinux_2_28_aarch64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.14.0

20 Jan 09:49
@github-actions github-actions
v0.14.0
0e626ed

Choose a tag to compare

View all tags
vLLM CPU v0.14.0

vLLM CPU Wheels

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu-avx512vnni Cascade Lake+ pip install "vllm-cpu-avx512vnni @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.0/vllm_cpu_avx512vnni-0.14.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512bf16 Cooper Lake+ pip install "vllm-cpu-avx512bf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.0/vllm_cpu_avx512bf16-0.14.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu (ARM64) ARM64/AArch64 pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.14.0/vllm_cpu-0.14.0-cp312-cp312-manylinux_2_28_aarch64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.13.0

19 Dec 11:33
@github-actions github-actions
v0.13.0
76a5b86

Choose a tag to compare

View all tags
vLLM CPU v0.13.0

vLLM CPU Wheels

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512 Skylake-X+ pip install "vllm-cpu-avx512 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu_avx512-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512vnni Cascade Lake+ pip install "vllm-cpu-avx512vnni @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu_avx512vnni-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512bf16 Cooper Lake+ pip install "vllm-cpu-avx512bf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu_avx512bf16-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-amxbf16 Sapphire Rapids+ pip install "vllm-cpu-amxbf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu_amxbf16-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu (ARM64) ARM64/AArch64 pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.13.0/vllm_cpu-0.13.0-cp312-cp312-manylinux_2_28_aarch64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.12.0

06 Dec 00:45
@github-actions github-actions
v0.12.0
b1afa78

Choose a tag to compare

View all tags
vLLM CPU v0.12.0

vLLM CPU Wheels

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu-0.12.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu-0.12.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512 Skylake-X+ pip install "vllm-cpu-avx512 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu_avx512-0.12.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512vnni Cascade Lake+ pip install "vllm-cpu-avx512vnni @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu_avx512vnni-0.12.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512bf16 Cooper Lake+ pip install "vllm-cpu-avx512bf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu_avx512bf16-0.12.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-amxbf16 Sapphire Rapids+ pip install "vllm-cpu-amxbf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu_amxbf16-0.12.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu (ARM64) ARM64/AArch64 pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.12.0/vllm_cpu-0.12.0-cp312-cp312-manylinux_2_17_aarch64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.11.2

06 Dec 00:44
@github-actions github-actions
v0.11.2
b1afa78

Choose a tag to compare

View all tags
vLLM CPU v0.11.2

vLLM CPU Wheels

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu-0.11.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu-0.11.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512 Skylake-X+ pip install "vllm-cpu-avx512 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu_avx512-0.11.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512vnni Cascade Lake+ pip install "vllm-cpu-avx512vnni @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu_avx512vnni-0.11.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-avx512bf16 Cooper Lake+ pip install "vllm-cpu-avx512bf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu_avx512bf16-0.11.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu-amxbf16 Sapphire Rapids+ pip install "vllm-cpu-amxbf16 @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu_amxbf16-0.11.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple
vllm-cpu (ARM64) ARM64/AArch64 pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.2/vllm_cpu-0.11.2-cp312-cp312-manylinux_2_17_aarch64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.11.1

06 Dec 00:45
@github-actions github-actions
v0.11.1
b1afa78

Choose a tag to compare

View all tags
vLLM CPU v0.11.1

vLLM CPU Wheels v0.11.1

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.1/vllm_cpu-0.11.1-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.1/vllm_cpu-0.11.1-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.11.0

06 Dec 00:44
@github-actions github-actions
v0.11.0
b1afa78

Choose a tag to compare

View all tags
vLLM CPU v0.11.0

vLLM CPU Wheels v0.11.0

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.0/vllm_cpu-0.11.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.11.0/vllm_cpu-0.11.0-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.10.2

06 Dec 00:45
@github-actions github-actions
v0.10.2
b1afa78

Choose a tag to compare

View all tags
vLLM CPU v0.10.2

vLLM CPU Wheels v0.10.2

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.10.2/vllm_cpu-0.10.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.10.2/vllm_cpu-0.10.2-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading

vLLM CPU v0.10.1.1

06 Dec 00:44
@github-actions github-actions
v0.10.1.1
b1afa78

Choose a tag to compare

View all tags
vLLM CPU v0.10.1.1

vLLM CPU Wheels v0.10.1.1

Automatically built from upstream vLLM release.

Quick Install from GitHub Release

pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.10.1.1/vllm_cpu-0.10.1.1-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

All Variants

Package Target CPUs Install Command (Python 3.12 x86_64)
vllm-cpu All CPUs (x86_64, ARM64) pip install "vllm-cpu @ https://github.com/MekayelAnik/vllm-cpu/releases/download/v0.10.1.1/vllm_cpu-0.10.1.1-cp312-cp312-manylinux_2_17_x86_64.whl" --index-url https://download.pytorch.org/whl/cpu --extra-index-url https://pypi.org/simple

Note: Replace cp312 with cp310, cp311, or cp313 for other Python versions. Replace x86_64 with aarch64 for ARM64 (only vllm-cpu supports ARM64).

Loading