Skip to content

Commit 26b31f1

Browse files
authored
Add usage data section
1 parent 8ec5cdf commit 26b31f1

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

_posts/2025-01-10-vllm-2024-wrapped-2025-vision.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -158,6 +158,19 @@ Through all these changes and challenges, our fundamental mission remains clear:
158158

159159
---
160160

161+
## Usage Data Collection
162+
163+
The metrics and insights throughout this post are powered by vLLM's [usage system](https://github.com/vllm-project/vllm/blob/main/vllm/usage/usage_lib.py), which collects anonymized deployment data. Each vLLM instance generates a UUID and reports technical metrics including:
164+
165+
* Hardware specs (GPU count/type, CPU architecture, available memory)
166+
* Model configuration (architecture, dtype, tensor parallelism degree)
167+
* Runtime settings (quantization type, prefix caching enabled)
168+
* Deployment context (cloud provider, platform, vLLM version)
169+
170+
This telemetry helps prioritize optimizations for common hardware configurations and identify which features need performance improvements. The data is collected locally in `~/.config/vllm/usage_stats.json`. Users can opt out by setting `VLLM_NO_USAGE_STATS=1`, `DO_NOT_TRACK=1`, or creating `~/.config/vllm/do_not_track`. The implementation details and full schema are available in our [usage stats documentation](https://docs.vllm.ai/en/latest/serving/usage_stats.html).
171+
172+
---
173+
161174
## Join the Journey
162175

163176
vLLM's 2024 journey demonstrates the transformative potential of open-source collaboration. With a clear vision for 2025, the project is poised to redefine AI inference, making it more accessible, scalable, and efficient. Whether through code contributions, attending [vLLM Office Hours](https://hubs.li/Q02TFDTT0), or adopting vLLM in production, every participant helps shape the future of this fast-moving project.

0 commit comments

Comments
 (0)