Qwen3.8 27B

User reports a fully local voice and chat assistant running Qwen3.8-27B (dense, 27.3B, Q8) at roughly 68 tok/s decode and ~1.5K tok/s prefill on 2x RTX PRO 4000 Blackwell 24GB, with an RTX 5060 Ti 16GB handling display and helper models. Setup is a patched llama.cpp build for Blackwell with speculative decoding (MTP, ~62% draft acceptance) and a vision projector, serving 256K context across 2 concurrent slots. The machine is an AMD Threadripper 9960X with 128 GB DDR5 ECC on Ubuntu 26.04, drawing ~820 W across GPUs and CPU. The user built a custom Python proxy (~22 modules) in front of llama-server with tool-calling, context compaction, a document workspace, and six MCP servers (filesystem, SearXNG web search, ChromaDB RAG with bge-m3, reminders, documents, sandboxed code editor). A voice pipeline with wake word, faster-whisper STT and Piper TTS is currently paused. The user asks for recommendations and comments.