llamaperf

Qwen3.5 9B

on RX 6800S 8GB · Ollama

Tone: negative
Oct 6, 2026
Throughput
2-3 t/s gen
System RAM
40 GB
VRAM reported
8 GB

Summary

User reports 2-3 t/s generation on an RX 6800S 8GB laptop with 40GB RAM and Ryzen 9 6900HS, across Qwen3.5 9B, Qwen3.8 27B, gpt-oss 20B and Gemma 4 31B, regardless of model size or whether the model fits fully in VRAM. Setup is Ollama (Vulkan and ROCm builds both tried) with LM Studio also tested, which reached the higher end of 3 t/s. Offloading layers to VRAM reportedly halves throughput, and Ollama sometimes falls back to full CPU load. User is asking for help diagnosing the bottleneck; no single throughput figure is given, only a 2-3 t/s range.