Qwen3.8 27B

User reports running Qwen3.8-27B (UD-IQ3_XXS GGUF) through TensorSharp on an M5 Pro MacBook Pro with 48 GB unified memory, decoding at approximately 20-43 tokens/second depending on draft acceptance. Setup is TensorSharp with DFlash2 speculative decoding (7 draft tokens per step), q8_0 KV cache and a 65,536-token context, driving the Pi coding agent over an OpenAI-compatible endpoint. First token took about 13-14 seconds from a cold ~4K prompt and 0.45-3.5 seconds on later rounds; the SDK run served 41,962 of 48,166 prompt tokens (87%) from the prefix cache. End-to-end bug-fix runs passed 5/5 tests in 88 seconds (CLI, 10 model requests) and 83.4 seconds (SDK, 8 requests). The CUDA/NInfer preset was not validated with Pi.