fsdp
Here are 53 public repositories matching this topic...
Best practices & guides on how to write distributed pytorch training code
-
Updated
Oct 22, 2025 - Python
Repo for Qwen Image Finetune
-
Updated
Jun 8, 2026 - Jupyter Notebook
Find slow PyTorch training bottlenecks: DataLoader stalls, low GPU utilization, rank stragglers, memory creep, and run regressions.
-
Updated
Jun 11, 2026 - Python
From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.
-
Updated
Jun 5, 2026 - Python
Write once, run anywhere; ezpz 🍋
-
Updated
Jun 11, 2026 - Python
A comprehensive hands-on guide to building production-grade distributed applications with Ray - from distributed training and multimodal data processing to inference and reinforcement learning.
-
Updated
Feb 12, 2026 - Jupyter Notebook
META LLAMA3 GENAI Real World UseCases End To End Implementation Guide
-
Updated
Sep 24, 2024 - Jupyter Notebook
Research platform for model training, evaluation, and experimentation across architectures, benchmarks, and recipes.
-
Updated
Jun 11, 2026 - Python
Fast and easy distributed model training examples.
-
Updated
Nov 26, 2024 - Python
A script for training the ConvNextV2 on CIFAR10 dataset using the FSDP technique for a distributed training scheme.
-
Updated
Dec 11, 2023 - Python
Simple and efficient implementation of 671B DeepSeek V3 that trainable with FSDP+EP and minimal requirement of 256x A100/H100, targeted for HuggingFace ecosystem
-
Updated
Jan 15, 2026 - Python
Minimal yet high performant code for pretraining llms. Attempts to implement some SOTA features. Implements training through: Deepspeed, Megatron-LM, and FSDP. WIP
-
Updated
Feb 6, 2024 - Python
Framework, Model & Kernel Optimizations for Distributed Deep Learning - Data Hack Summit
-
Updated
Aug 1, 2023 - Python
Implementations of some popular approaches for efficient deep learning training and inference
-
Updated
Mar 30, 2025 - Python
Improve this page
Add a description, image, and links to the fsdp topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the fsdp topic, visit your repo's landing page and select "manage topics."