llamaperf

Qwen3.8 27B

on AMD RX 7900 XTX · llama.cpp

Tone: mixedAMD hardware
Sep 7, 2026
Throughput
72.1 t/s gen
Quant
Q4_K_M
VRAM reported
24 GB

Use cases

summarization

Summary

User compares Qwen3.8-27B against Qwen3.6-27B on a fact-extraction task, where Qwen3.8 scores 0.7030 F1 against Qwen3.6's 0.7177, a statistical tie. Decode throughput falls from 85.6 to 72.1 t/s, about 16%, under the closest saved configs, though the runs used different llama.cpp builds. Qwen3.8 produces shorter answers, lowering end-to-end latency. The user expected larger gains from public benchmarks, and sees small gains on task-specific tests but massive gains only on benchmarks the model was trained on.