Qwen3.5 9B
on RX 6800S 8GB · Ollama
Summary
User reports 2-3 t/s generation on an RX 6800S 8GB laptop with 40GB RAM and Ryzen 9 6900HS, across Qwen3.5 9B, Qwen3.8 27B, gpt-oss 20B and Gemma 4 31B, regardless of model size or whether the model fits fully in VRAM.
Setup is Ollama (Vulkan and ROCm builds both tried) with LM Studio also tested, which reached the higher end of 3 t/s. Offloading layers to VRAM reportedly halves throughput, and Ollama sometimes falls back to full CPU load.
User is asking for help diagnosing the bottleneck; no single throughput figure is given, only a 2-3 t/s range.