llamaperf

Qwen3.8 27B

on NVIDIA RTX PRO 6000 Max-Q · NInfer · 262,144 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
96.8 t/s gen
Quant
groupwise-int
KV cache
Q8
System RAM
126 GB
VRAM reported
96 GB

Use cases

codingagenticlong-context

Summary

User reports a long coding-agent session with DeepSeek Harness at a weighted 96.8 t/s streaming rate and a median of 104.4 t/s. The model is a groupwise-int artifact, not NVFP4. Context compaction worked well.