Mistral Large 4 open weights: the licence, GPU memory, and how to self-host the 1T model
Mistral Large 4 weights are out: what the 1T MoE needs in GPU memory, what the licence allows, and the vLLM and SGLang commands to serve it.
#vllm
Every article tagged #vllm, across topics.
#vllm articles
Kimi K3.1 Pro: API, pricing, benchmarks, and what the open weights will need
Kimi K3.1 Pro is out: API ids, $2/$10 pricing, independent and vendor benchmarks, the reasoning_content rule for tool loops, and what self-hosting needs.
DeepInfer explained: how DeepSeek's open-source inference engine serves V4.1 Flash, and what it takes to run it
DeepSeek open-sourced DeepInfer, the engine behind V4.1 Flash: what it includes, what it leaves out, the hardware it needs and how to run it.