Popular repositories Loading

1. git-lean-test git-lean-test Public

   A test for learnning git

2. Foundations-of-LLMs Foundations-of-LLMs Public

   Forked from ZJU-LLMs/Foundations-of-LLMs

3. speculators speculators Public

   Forked from vllm-project/speculators

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python

4. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

5. SpecForge SpecForge Public

   Forked from sgl-project/SpecForge

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python

6. AngelSlim_sunny AngelSlim_sunny Public

   Forked from Tencent/AngelSlim

   Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

   Python