Qwen3.5 0.8B
on Unknown GPU
Summary
User reports Qwen3.5 0.8B BF16 at roughly 3-3.2 t/s on a 7800X3D with 32 GB DDR5, running CPU-only single-threaded inference.
Time to first token grows non-monotonically and tracks prompt token count.
on Unknown GPU