Summary
User reports running Qwen3.8 Flash-Next quantized builds on an RTX 5090 with 64GB of system RAM, fitting Atomic Q4_K_M at 4.27bpw with 31 layers offloaded and Swift IQ4_XS with 32 layers offloaded.
Setup uses partial CPU offload to fit the models in memory; the user notes that offloading more layers would cause a significant slowdown.
User reports around 40 tok/s when staying in the 34-30 layer offload range, and asks whether a larger quant of a 27B model would be more capable than the cut-down Flash-Next builds.