llamaperf

Qwen3.8 27B Swift-1.5

on 2× NVIDIA RTX 4070 · Strata

Tone: mixedNVIDIA hardware
Oct 24, 2026
Throughput
13.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
32 GB

Use cases

coding

Summary

User compares Swift-1.5-Qwen3.8-27B at around 13 tokens/sec against Strata on an RTX 4070 12 GB plus RTX 3060 12 GB with 32GB DDR4, running the same instruction runsheet. Qwen3.8-27B runs Q4_K_M; Strata runs IQ3_XXS with experts streamed from an experts.bin file on an M.2 SSD, context varied from 96k to 160k, KV cache tried as Int8, q8v4 and q4_0, kv-resident 20480 to 32768. Strata reached around 17 tokens/sec, 31-36 t/s for plain text generation and 20-25 t/s for logic/coding, with 5700 to 6800 experts in VRAM and system RAM maxed. Lowering kv-resident raised experts in VRAM but ran 3-4 t/s slower. User asks where the bottleneck is and which low-RAM flags to use.