Speculative Decoding’s Ceiling Just Moved With DFlash

A serving engineer watches tokens arrive in that familiar trickle: fast enough to demo, slow enough to feel like the model is still pecking at a keyboard. DFlash matters because it proposes a way out of that rhythm. Here is the real claim in one sentence: DFlash is the first credible path to turning speculative decoding from an optimization trick into a serving architecture, because it removes the hidden assumption that the drafter has to be sequential. The factual part is compact. Z Lab’s DFlash replaces the usual autoregressive drafter in speculative decoding with a lightweight block diffusion model that drafts a whole chunk of tokens in parallel, conditioned on hidden features from the target model. The authors report over 6× lossless acceleration on some setups, plus up to 2.5× better speedup than EAGLE-3 on Qwen3-8B, with support wired into SGLang and early vLLM paths noted in the repo. Those are promising author-run results, not a field-wide verdict. But the number is not the sto