Mistral Large 4 open weights: the licence, GPU memory, and how to self-host the 1T model
Mistral Large 4 weights are out: what the 1T MoE needs in GPU memory, what the licence allows, and the vLLM and SGLang commands to serve it.
#speculative-decoding
Every article tagged #speculative-decoding, across topics.
#speculative-decoding articles
DeepInfer explained: how DeepSeek's open-source inference engine serves V4.1 Flash, and what it takes to run it
DeepSeek open-sourced DeepInfer, the engine behind V4.1 Flash: what it includes, what it leaves out, the hardware it needs and how to run it.