Qwen3.8 Flash-Next-REAP-320

on NVIDIA RTX 5060 Ti 16GB · llama.cpp · 65,536 ctx

Sep 14, 2026

Throughput

18.3 t/s gen · 25.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

Q4 (GGUF)

KV cache

q4_0

System RAM

32 GB

VRAM reported

16 GB

Summary

User reports Qwen3.8 Flash-Next-REAP-320 at 18.3 t/s generation and 25.4 t/s prefill on an RTX 5060 Ti 16GB with 32GB system RAM. Setup is llama.cpp with a Q4 GGUF, 64k context, q4_0 KV cache, --n-cpu-moe 34, --ngl 48, and lazy mmap for the 29.48 GB n-gram embedding. User notes the model is smarter than Qwen3.8 27B but keeps the 27B as daily driver due to 5x faster prompt processing.

View source ↗