Popular repositories Loading

1. lighteval lighteval Public

   Forked from huggingface/lighteval

   Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

   Python

2. nvidia-resiliency-ext nvidia-resiliency-ext Public

   Forked from NVIDIA/nvidia-resiliency-ext

   NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the effective training time by minimizing the downtime due to fa…

   Python

3. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

4. apex apex Public

   Forked from NVIDIA/apex

   A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

   Python

5. TransformerEngine TransformerEngine Public

   Forked from NVIDIA/TransformerEngine

   A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

   Python

6. xformers xformers Public

   Forked from facebookresearch/xformers

   Hackable and optimized Transformers building blocks, supporting a composable construction.

   Python