Skip to content

@moreh-dev Moreh Team

All

    Repositories list

    69 repositories

    • ATOM

      Public
      AiTer Optimized Model
      Python
      •
      MIT License
      •161•0•0•0•Updated Oct 21, 2026Oct 21, 2026

    • sglang

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      •
      Apache License 2.0
      •9.8k•0•0•4•Updated Oct 21, 2026Oct 21, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •24k•2•0•6•Updated Oct 20, 2026Oct 20, 2026

    • rocm-aiter

      Public
      AI Tensor Engine for ROCm
      Python
      •
      MIT License
      •647•0•0•4•Updated Oct 20, 2026Oct 20, 2026

    • plate-cli

      Public
      plate CLI
      0•0•0•0•Updated Oct 16, 2026Oct 16, 2026

    • helm-charts

      Public
      Helm Chart Repository
      helm
      helm
      Makefile
      •0•0•0•0•Updated Oct 16, 2026Oct 16, 2026

    • runes

      Public
      Moreh agent skills
      JavaScript
      •0•0•0•1•Updated Oct 16, 2026Oct 16, 2026

    • mif

      Public
      MIF: MoAI Inference Framework
      mif
      mif
      MDX
      •0•0•0•0•Updated Oct 13, 2026Oct 13, 2026

    • sampled-longbenchv2

      Public
      Long context dataset sampled from original zai-org/LongBench-v2
      Python
      •0•1•0•0•Updated Sep 14, 2026Sep 14, 2026

    • openbench-runner

      Public
      Configurable OpenBench runner for GPQA Diamond and TAU Bench Verified Airline across OpenRouter, vLLM, and OpenAI-compatible endpoints.
      Python
      •
      MIT License
      •0•0•0•0•Updated Sep 14, 2026Sep 14, 2026

    • test-docs.moreh.io

      Public
      HTML
      •0•0•0•0•Updated Sep 8, 2026Sep 8, 2026

    • llm-d-inference-scheduler

      Public
      Inference scheduler for llm-d
      Go
      •
      Apache License 2.0
      •476•0•0•0•Updated Aug 10, 2026Aug 10, 2026

    • llm-d-kv-cache

      Public
      Distributed KV cache coordinator
      Go
      •
      Apache License 2.0
      •167•0•0•0•Updated Jul 24, 2026Jul 24, 2026

    • inference-perf

      Public
      GenAI inference performance benchmarking tool
      Python
      •
      Apache License 2.0
      •143•0•0•0•Updated Jul 19, 2026Jul 19, 2026

    • kvcached

      Public
      Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
      Python
      •
      Apache License 2.0
      •228•0•0•1•Updated May 19, 2026May 19, 2026

    • LMCache

      Public
      Redis for LLMs
      Python
      •
      Apache License 2.0
      •2.1k•0•0•1•Updated May 14, 2026May 14, 2026

    • Mooncake

      Public
      Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
      C++
      •
      Apache License 2.0
      •1.4k•0•0•0•Updated May 6, 2026May 6, 2026

    • gateway-api-inference-extension

      Public
      Gateway API Inference Extension
      Go
      •
      Apache License 2.0
      •321•0•0•0•Updated Apr 30, 2026Apr 30, 2026

    • pre-commit-hooks

      Public
      git pre-commit hook for automation
      pre-commitpre-commit-hooks
      pre-commitpre-commit-hooks
      Python
      •0•0•0•0•Updated Apr 26, 2026Apr 26, 2026

    • tt-umd

      Public
      User-Mode Driver for Tenstorrent hardware
      C++
      •
      Apache License 2.0
      •57•0•0•0•Updated Mar 27, 2026Mar 27, 2026

    • skypilot

      Public
      SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
      Python
      •
      Apache License 2.0
      •1.3k•0•0•0•Updated Mar 15, 2026Mar 15, 2026

    • hwlog

      Public
      hwlog for system health check and logs
      Go
      •0•0•0•0•Updated Mar 11, 2026Mar 11, 2026

    • vllm-pcp

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •24k•0•0•3•Updated Feb 27, 2026Feb 27, 2026

    • SpecForge

      Public
      Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
      Python
      •
      MIT License
      •370•0•0•0•Updated Jan 23, 2026Jan 23, 2026

    • mori

      Public
      Modular RDMA Interface
      C++
      •
      MIT License
      •111•0•0•2•Updated Jan 22, 2026Jan 22, 2026

    • mi355_benchmark

      Public
      repo for MI355X benchmark (TensorWave)
      Shell
      •
      Apache License 2.0
      •337•0•0•0•Updated Nov 26, 2025Nov 26, 2025

    • transformers-sp-prefill

      Public
      🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference an…
      Python
      •
      Apache License 2.0
      •35k•0•0•0•Updated Nov 26, 2025Nov 26, 2025

    • flash-attention-sinks

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •3.2k•0•0•0•Updated Nov 17, 2025Nov 17, 2025

    • transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •35k•2•0•0•Updated Oct 31, 2025Oct 31, 2025

    • gpt-oss

      Public
      Inference gpt-oss in one file of pure C
      Python
      •2.7k•1•0•0•Updated Oct 12, 2025Oct 12, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.