Qwen3.8 27B

User reports running Qwen3.8-27B (UD-IQ3_XXS) through TensorSharp as the backend for the Pi Coding Agent on an M5 Pro MacBook Pro with 48 GB unified memory, with decode throughput ranging from approximately 20 to 43 tokens/second. Setup is TensorSharp with a Q8_0 KV cache, a 65,536-token context limit, and DFlash2 speculative decoding using a Qwen3.8-27B-DFlash2-Q4_K_M draft model at seven draft tokens per step. The SDK run used 48,166 prompt tokens with 41,962 served from prefix cache (about 87%) and 2,117 generated tokens; initial prefill was about 3.9K-4.1K tokens with TTFT around 13-14 seconds, later requests 0.45-3.5 seconds. The CLI and SDK E2E runs each passed 5/5 tests in 88 s and 83.4 s respectively. The user notes these are single-run observations, not a standardized benchmark.