Skip to content
@huggingface

Hugging Face

The AI community building the future.

Pinned Loading

  1. transformers transformers Public

    🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

    Python 129k 25.5k

  2. diffusers diffusers Public

    🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

    Python 23.9k 4.9k

  3. datasets datasets Public

    🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

    Python 18.7k 2.6k

  4. peft peft Public

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python 14.9k 1.4k

  5. accelerate accelerate Public

    🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

    Python 7.3k 873

  6. optimum optimum Public

    🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

    Python 2.3k 402

Repositories

Showing 10 of 232 repositories
  • huggingface/bench_cluster’s past year of commit activity
    Python 1 0 0 0 Updated Jul 4, 2024
  • optimum-tpu Public

    Google TPU optimizations for transformers models

    huggingface/optimum-tpu’s past year of commit activity
    Python 40 Apache-2.0 8 5 2 Updated Jul 4, 2024
  • optimum-quanto Public

    A pytorch quantization backend for optimum

    huggingface/optimum-quanto’s past year of commit activity
    Python 649 Apache-2.0 35 14 (2 issues need help) 1 Updated Jul 4, 2024
  • nanotron Public

    Minimalistic large language model 3D-parallelism training

    huggingface/nanotron’s past year of commit activity
    Python 946 Apache-2.0 86 36 (15 issues need help) 30 Updated Jul 4, 2024
  • huggingface/cosmopedia’s past year of commit activity
    Python 342 Apache-2.0 29 5 3 Updated Jul 4, 2024
  • accelerate Public

    🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

    huggingface/accelerate’s past year of commit activity
    Python 7,332 Apache-2.0 873 110 14 Updated Jul 4, 2024
  • cookbook Public

    Open-source AI cookbook

    huggingface/cookbook’s past year of commit activity
    Jupyter Notebook 1,473 Apache-2.0 198 15 18 Updated Jul 4, 2024
  • dataset-viewer Public

    Lightweight web API for visualizing and exploring any dataset - computer vision, speech, text, and tabular - stored on the Hugging Face Hub

    huggingface/dataset-viewer’s past year of commit activity
    Python 640 Apache-2.0 65 134 (7 issues need help) 9 Updated Jul 4, 2024
  • lighteval Public

    LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

    huggingface/lighteval’s past year of commit activity
    Python 469 MIT 54 48 (2 issues need help) 12 Updated Jul 4, 2024
  • blog Public

    Public repo for HF blog posts

    huggingface/blog’s past year of commit activity
    Jupyter Notebook 2,136 655 135 (1 issue needs help) 69 Updated Jul 4, 2024