Skip to content

@ModelCloud ModelCloud.ai

Change the repository type filter

All

    Repositories list

    14 repositories

    • GPTQModel

      Public
      LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
      transformersquantizationoptimumpeftvllmgptqsglang
      Python
      •
      Other
      •160•1k•44•15•Updated Feb 15, 2026Feb 15, 2026

    • Tokenicer

      Public
      A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.
      trainingtokenizerinferencetoken
      Python
      •
      Apache License 2.0
      •4•10•0•0•Updated Feb 9, 2026Feb 9, 2026

    • LogBar

      Public
      A unified Logger and ProgressBar util with zero dependencies.
      Python
      •
      Apache License 2.0
      •0•8•0•0•Updated Dec 24, 2025Dec 24, 2025

    • PyPcre

      Public
      Python
      •
      Apache License 2.0
      •2•2•0•1•Updated Dec 16, 2025Dec 16, 2025

    • Device-SMI

      Public
      Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-…
      devicecpugpusminpuxpu
      Python
      •
      Apache License 2.0
      •1•14•0•1•Updated Dec 12, 2025Dec 12, 2025

    • MemLord

      Public
      Python
      •
      Apache License 2.0
      •0•1•0•1•Updated Nov 21, 2025Nov 21, 2025

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •3.1k•0•0•0•Updated Apr 17, 2025Apr 17, 2025

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •14k•1•0•0•Updated Mar 27, 2025Mar 27, 2025

    • rockthem

      Public
      Cuda
      •
      Apache License 2.0
      •0•0•0•0•Updated Mar 13, 2025Mar 13, 2025

    • platinum-benchmarks

      Public
      Python
      •
      Creative Commons Attribution 4.0 International
      •3•0•0•0•Updated Mar 6, 2025Mar 6, 2025

    • peft

      Public
      🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
      Python
      •
      Apache License 2.0
      •2.2k•0•0•0•Updated Mar 4, 2025Mar 4, 2025

    • sglang

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      •
      Apache License 2.0
      •4.5k•0•0•0•Updated Mar 4, 2025Mar 4, 2025

    • transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •32k•0•0•0•Updated Feb 12, 2025Feb 12, 2025

    • optimum

      Public
      🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
      Python
      •
      Apache License 2.0
      •617•1•0•0•Updated Feb 7, 2025Feb 7, 2025