All pull requests

Pull requests

• converter: parallelize CPU weight conversion

  #389·Xtravaganz opened Oct 10, 2026·

  ·
  4

• fix(bench): track the serving request log schema bump to 25

  #388·troubadour-hell opened Oct 10, 2026·

  ·
  4

• feat(jev): parallel-decision making through /v1/decision & /v1/systemone

  #387·CommanderTurtle opened Oct 9, 2026·

  ·
  22

• Draft: noncausal single-pass decision inference for pplx-decider-v1.1-27b

  #384·porochickenrye opened Oct 9, 2026·

  ·

• Custom tool support

  #382·loomz opened Oct 8, 2026·

  ·
  1

• feat(serve): automatic shared-prefix write at the system/developer frontier (rebase of #152)

  #368·kaushikvira opened Oct 5, 2026·

  ·

• perf(linear_add): fill the device for the nvfp4 down projection at verify widths

  #365·CaptainArni opened Oct 4, 2026·

  ·

• perf(attention): split the KV range across CTAs in nvfp4 tiled prefill

  #355·DuncanBetts opened Oct 1, 2026Contributor·

  ·

• feat(qwen): add per-lane retrieval KV windows with media replay

  #345·qzshch opened Sep 30, 2026·

  ·

• feat(attention): support nonresident pages in causal KV tables

  #344·qzshch opened Sep 30, 2026·

  ·

• feat(ops): accumulate represented feature spans for retrieval

  #343·qzshch opened Sep 30, 2026·

  ·

• fix(serve): set SO_REUSEADDR on the HTTP listener

  #340·DuncanBetts opened Sep 30, 2026Contributor·

  ·

• fix(runtime): report payload bytes for state-image transfers

  #338·qzshch opened Sep 30, 2026·

  ·
  1

• feat(tools): attach encoded DFlash2 components to compatible v3 artifacts

  #337·qzshch opened Sep 30, 2026·

  ·
  1

• feat(prefix-cache): replace the checkpoint catalog with a hybrid prefix cache

  #335·Wallawalla47 opened Sep 30, 2026·

  ·
  5

• feat(ops): add FP8 TMA pilot for the attn Prefill route

  #324·DuncanBetts opened Sep 26, 2026Contributor·

  ·
  1

• fix(models): recover tool calls after a quoted open marker

  #318·adubkov opened Sep 25, 2026Contributor·

  ·
  1

  1

• serve: safely recover Qwen tool calls and accept Copilot/OpenAI agent tool shapes

  #316·paq85 opened Sep 24, 2026·

  ·
  3

• perf(ops): pipeline Q4/Q5 Attention groups at T32

  #311·MOVIBALE opened Sep 23, 2026Contributor·

  ·

• refactor(ops): single-pass online log-sum-exp in target_logprobs

  #307·DuncanBetts opened Sep 23, 2026Contributor·

  ·
  1

• bench: add inference speed-of-light estimator

  #304·DuncanBetts opened Sep 23, 2026Contributor·

  ·
  2

• fix(frontend): keep the last value on a duplicate tool-call parameter

  #299·adubkov opened Sep 21, 2026Contributor·

  ·
  1

• fix(core): preserve workspace layout state after allocation overflow

  #297·DuncanBetts opened Sep 20, 2026Contributor·

  ·
  2

• feat(serve): accept reasoning.summary and include:reasoning.encrypted_content

  #295·Macasacker opened Sep 20, 2026·

  ·
  1

• feat: add XGrammar structured output with speculative decoding

  #294·magnetism87 opened Sep 19, 2026·

  ·
  1