llamaperf

Qwen3.8 27B Uncensored-HauHauCS

on NVIDIA RTX 4090 · NInfer · 262,144 ctx

NVIDIA hardware
Oct 8, 2026
Throughput
130.0 t/s gen
Quant
INT8

Summary

User reports Qwen3.8 27B Uncensored-HauHauCS at about 130 t/s decode on an RTX 4090. Setup is NInfer with INT8 quantization, 262K context, and a model size of about 17 GB. The user notes this is a port in progress, with a CPU build possibly running overnight; the 130 t/s is an expected figure rather than a measured result.