Skip to content

FEP(sig-framework): vLLM-Plugin-FL features for FlagOS 2.2 - #89

Open
wbavon wants to merge 4 commits into
mainfrom
fep-vllm-plugin-fl-2.2
Open

FEP(sig-framework): vLLM-Plugin-FL features for FlagOS 2.2#89
wbavon wants to merge 4 commits into
mainfrom
fep-vllm-plugin-fl-2.2

Conversation

@wbavon

@wbavon wbavon commented Jul 30, 2026

Copy link
Copy Markdown
Collaborator

Provisional FEP for the vllm-plugin-FL work planned for the FlagOS 2.2 cycle:

  1. 10-vendor adaptation on vLLM 0.20.2 + 5-vendor upgrade to vLLM 0.24.0 (Empty mode).
  2. Empty-build support — device-less vLLM build with the plugin supplying the hardware layer.
  3. Operator-granularity auto-tuning — per-platform selection of the best operator implementation.

Owner and the marked TODOs (per-vendor acceptance bar, the 5 committed 0.24.0 vendors, auto-tuning design) to be filled before Implementable (FEP Freeze 2026-08-14).

@CLAassistant

CLAassistant commented Jul 30, 2026

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ wbavon
❌ yunbowang328
You have signed the CLA already but the status is still pending? Let us recheck it.

@wbavon wbavon added FEP FlagOS Enhancement Proposal sig/framework SIG: framework target/2.2 Target release: FlagOS 2.2 labels Aug 1, 2026
…#333

#325 was closed as wrong (experiment ran on CPU vLLM); #319's guard never
fired and was superseded by #333 (flag_gems dispatch routing).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

FEP FlagOS Enhancement Proposal sig/framework SIG: framework target/2.2 Target release: FlagOS 2.2

Projects

Status: Todo

Development

Successfully merging this pull request may close these issues.

3 participants