Qwen3.8 27B OrcaRouter Uncensored
on NVIDIA RTX 5070 Ti · den_llama.cpp · 32,768 ctx
Use cases
long-contextagentictool-use
Summary
User reports Qwen3.8-27B at 82.73 t/s median (79.4-89.6) on an RTX 5070 Ti 16 GB at 32K context.
Setup is the den_llama.cpp fork (golden build2) with IQ3_XXS GGUF weights, MTP speculative decoding at n-max 2, accept rate 0.6703, prefill 706 t/s, np=1.
At 65K context the median is 64.16 t/s (51.11-72.48) with q8_0 K / q4_0 V cache. A separate FA-fix build measured 79.48 t/s median at 65K (+23.9% vs control) but was marked experiment, not golden. Build3 adds NVFP4 KV at 88.6 t/s decode (KLD 0.0151) and a Q4_G64 KV codec (KLD 0.0163). A gemma-4-26B-A4B MoE lane runs 94-117 t/s with partial CPU+GPU expert offload (-ncmoe 4), and 129 t/s with q8_0/q4_0 KV and -ncmoe 2.