My Weird Prompts
Daniel Rosehill
Podcast
Episodes
Listen, download, subscribe
Serving DeepSeek-V4.1-Flash on Your Own GPU
You've got the weights, you've got the rack, you've got a GPU bolted in that you're not replacing. So which engines can actually serve DeepSeek-V4.1-Flash — and how much of your "engine choice" is really a hardware decision wearing a software costume? This episode walks the five-name shortlist (vLLM, SGLang, TensorRT-LLM, llama.cpp, ONNX Runtime) against the model card's supported paths, then runs the two-server thought experiment: one NVIDIA box, one AMD box, same budget line, wildly different menus. Along the way: why the most portable engine is the one that can't load the model, why "supports AMD" and "supports your AMD card" are two different sentences, and why the quantization method printed on the checkpoint can decide whether your inference runs at all. Key sources: • DeepSeek API Change Log (2026-09-10 V4.1-Flash release; full history) — https://api-docs.deepseek.com/updates • DeepSeek-V4.1-Flash model card (architecture, benchmarks, local-app paths) — https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash • DeepSeek-V4-Flash model card — https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash Episode 5900 — myweirdprompts.com/n/5900 (permanent short link: myweirdprompts.com/915386)
My Weird Prompts RSS Feed
