llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 5070 Ti · 256,000 ctx

Tone: mixedNVIDIA hardware
Sep 26, 2026
Throughput
40.0 t/s gen
Quant
Q8
KV cache
Q8
System RAM
96 GB

Summary

User asks whether Qwen3.8 Flash-Next can run on a mixed RTX 5070 Ti 16GB plus Radeon AI PRO R9700 32GB box with 96GB DDR5 system RAM. They report Qwen3.6 27B already runs on both cards with layer split at 40 tok/s using Q8 weights and Q8 KV cache at 256k context. They also mention losing two days to an AMD Pro driver unload bug that freezes the system, and ask for quant, tok/s, context size, launch flags, and mixed NVIDIA/AMD advice.