Skip to content
@lightseekorg

LightSeek Foundation

To accelerate open research and open-source innovation for the next generation of artificial intelligence systems.

Welcome to LightSeek Foundation

icon LightSeek Foundation is a 501(c)(3) nonprofit organization advancing open research and open-source innovation for the next generation of artificial intelligence systems. We believe the future of AI should be transparent, collaborative, and inclusive. LightSeek exists to accelerate the development of open, efficient, and trustworthy AI systems—so that progress in AI benefits everyone, not just a few.

LightSeek Foundation is a Silver Member of the PyTorch Foundation.

Ecosystem Projects

SMG: Shepherd Model Gateway is a high-performance inference gateway for production LLM deployments.

TorchSpec: TorchSpec is a PyTorch native library for training speculative decoding models.

Mooncake (Partnership): Mooncake is a transfer engine designed for KV cache management in production LLM serving.

Follow Us

Stay connected with the LightSeek Foundation. Follow us for the latest updates on open research, infrastructure, and open-source AI systems.

icon https://lightseek.org

icon https://lnkd.lightseek.org

icon https://x.com/lightseekorg

icon https://github.lightseek.org

icon https://hf.co/lightseekorg

Contact Us

We welcome collaboration with researchers, engineers, and organizations worldwide. For partnerships, research collaboration, sponsorship opportunities, or general inquiries, please reach out to us.

icon contact@lightseek.org

Pinned Loading

  1. smg smg Public

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat histor…

    Rust 172 48

  2. TorchSpec TorchSpec Public

    A PyTorch native library for training speculative decoding models

    Python 83 12

Repositories

Showing 5 of 5 repositories
  • smg Public

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

    lightseekorg/smg’s past year of commit activity
    Rust 172 Apache-2.0 48 93 60 Updated Apr 17, 2026
  • TorchSpec Public

    A PyTorch native library for training speculative decoding models

    lightseekorg/TorchSpec’s past year of commit activity
    Python 83 MIT 12 8 1 Updated Apr 16, 2026
  • .github Public
    lightseekorg/.github’s past year of commit activity
    0 MIT 0 0 0 Updated Apr 16, 2026
  • triton Public Forked from triton-lang/triton

    Triton language and compiler releases for LightSeek Foundation

    lightseekorg/triton’s past year of commit activity
    MLIR 0 MIT 2,808 0 0 Updated Apr 16, 2026
  • smg-dev-guide Public

    Shepherd Model Gateway Claude Code Skills

    lightseekorg/smg-dev-guide’s past year of commit activity
    9 Apache-2.0 1 0 0 Updated Mar 9, 2026