-
Notifications
You must be signed in to change notification settings - Fork 1.5k
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
[BUG]: ray missing from vllm runtime images
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingdeployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetesdynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentruntimeCODEOWNER area -> @ai-dynamo/dynamo-runtime-codeownersCODEOWNER area -> @ai-dynamo/dynamo-runtime-codeownersStatus: Open.#14020 In ai-dynamo/dynamo;[BUG]: Disaggregated vLLM serving with n>1 drops KV handoff for all but one choice
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingdynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentfault-toleranceCODEOWNER area -> @ai-dynamo/dynamo-fault-tolerance-codeownersCODEOWNER area -> @ai-dynamo/dynamo-fault-tolerance-codeownersStatus: Open.#14018 In ai-dynamo/dynamo;bug: preserve EngineShutdown when vLLM abort ends generation
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingdynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentfault-toleranceCODEOWNER area -> @ai-dynamo/dynamo-fault-tolerance-codeownersCODEOWNER area -> @ai-dynamo/dynamo-fault-tolerance-codeownerslanguage::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python coderuntimeCODEOWNER area -> @ai-dynamo/dynamo-runtime-codeownersCODEOWNER area -> @ai-dynamo/dynamo-runtime-codeownersStatus: Open.#13993 In ai-dynamo/dynamo;[FEATURE]: Add a configurable hard output-token limit to the SGLang backend
backend::sglangRelates to the sglang backendRelates to the sglang backendStatus: Open.#13988 In ai-dynamo/dynamo;Stream Qwen native XML tool-call arguments before function close
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingdynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm componentfrontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust codeStatus: Open.#13982 In ai-dynamo/dynamo;[BUG]: tool_call_dispatch cannot safely reconstruct fragmented arguments
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingfrontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust codeStatus: Open.#13972 In ai-dynamo/dynamo;[CONTRIBUTION]: Make ThunderAgent's cost model DP-rank aware
backend::sglangRelates to the sglang backendRelates to the sglang backendbugSomething isn't workingSomething isn't workingcontribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a changedynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm componentdynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentlanguage::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python coderouterRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.Status: Open.#13968 In ai-dynamo/dynamo;[BUG]: Chat prompt_logprobs only returned on nvext, not on the OpenAI choice
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingfrontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust codeStatus: Open.#13941 In ai-dynamo/dynamo;[FEATURE]: Qwen3.8-Flash-Next Recipe
backend::vllmRelates to the vllm backendRelates to the vllm backenddynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentenhancementNew feature or requestNew feature or requestStatus: Open.#13940 In ai-dynamo/dynamo;feat(vllm-omni): add Cosmos3 image and video generation support
diffusionCODEOWNER area -> @ai-dynamo/dynamo-diffusion-codeownersCODEOWNER area -> @ai-dynamo/dynamo-diffusion-codeownersStatus: Open.#13938 In ai-dynamo/dynamo;feat(vllm-omni): qualify MiniMax-H3 T2VA on B200
backend::vllmRelates to the vllm backendRelates to the vllm backenddiffusionCODEOWNER area -> @ai-dynamo/dynamo-diffusion-codeownersCODEOWNER area -> @ai-dynamo/dynamo-diffusion-codeownersroadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapStatus: Open.#13937 In ai-dynamo/dynamo;[Roadmap]: Track Dynamo 2.0 diffusion work
diffusionCODEOWNER area -> @ai-dynamo/dynamo-diffusion-codeownersCODEOWNER area -> @ai-dynamo/dynamo-diffusion-codeownersprocessCODEOWNER area -> @ai-dynamo/dynamo-process-codeownersCODEOWNER area -> @ai-dynamo/dynamo-process-codeownersroadmapTracks features, enhancements, or milestones planned as part of the project roadmapTracks features, enhancements, or milestones planned as part of the project roadmapStatus: Open.#13935 In ai-dynamo/dynamo;