llamaperf

Tiel-Coder 35B (3B active)

on AMD RX 7800 XT 16GB · shura.cpp

Tone: positiveAMD hardware
Oct 28, 2026
Throughput
75.0 t/s gen
System RAM
32 GB
VRAM reported
16 GB

Use cases

coding

Summary

User reports Tiel-Coder-35B-A3B at around 75 tok/s decode on short prompts on an RX 7800 XT 16GB, dropping to about 49 tok/s at 100K context. Setup is shura.cpp, a llama.cpp fork with an automatic VRAM governor that keeps 1.5 GiB of VRAM free for the desktop, on a Ryzen 5 5600 with 32GB DDR4-3200 under Fedora and ROCm 7.2.4. Experts are cached on the GPU with the rest in system RAM. Prefill improved 16.3% at 28K context and 7.9% at 100K over the previous build, with short-context decode basically unchanged. KL divergence was 0.0346 against a 0.0343 self-comparison baseline. A 40-minute stress test of 384 requests mixing 28-34K prompts had no failed requests. Only AMD gfx1101 with ROCm was benchmarked; CUDA builds compile but are untested.