Qwen3.8 27B

Source and attribution: u/LemesoftNostalgic, "Running some unsloth models on a dual-RTX 3060 workstation — exact setup + tok/s numbers", https://www.reddit.com/user/LemesoftNostalgic/comments/1wxc5tw/running_some_unsloth_models_on_a_dualrtx_3060/ . Primary source re-opened through the web reader on 2026-10-13; the returned primary-page snapshot was labelled crawled three days earlier. No direct live-HTTP timestamp is claimed. The page has only a relative post age; exact publication and measurement dates are unknown. This is an author-reported native benchmark, not an independently repeated run. Model: Qwen3.8 27B, GGUF, table quant Q4_K_S; source model-file size 14.29 GiB. The benchmark table calls the quant Q4_K_S; the separate serving command names Qwen3.8-27B-UD-Q4_K_S.gguf. A current public file with that exact filename was opened at https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/blob/main/Qwen3.8-27B-UD-Q4_K_S.gguf . This is a verified filename match and plausible source, not proof of the tested GGUF or revision. Preserve Q4_K_S as the measured table label; do not silently replace it with a verified UD benchmark claim. Upstream/base-model reference only: https://huggingface.co/Qwen/Qwen3.8-27B . Tested GGUF revision and checksum are unknown. Hardware: two NVIDIA RTX 3060 GPUs totaling 24 GB nominal VRAM (2 x 12 GB mapping), each reported at PCIe Gen3 x16; HP Z440 workstation, Intel Xeon E5-2690 v3 (12 cores / 24 threads), 96 GB ECC DDR4 in four channels, 256 GB NVMe plus 1 TB SATA, 700 W PSU. Xubuntu 24.04 LTS, NVIDIA driver 580.173.02 and CUDA 13.0 are source-reported system details. Neither GPU power limit nor actual benchmark resident RAM/VRAM is reported. Native benchmark results: PP512 755 t/s and TG128 30.8 t/s. The author explicitly defines pp512 as llama-bench prompt processing and tg128 as llama-bench token generation. These are separate tests with 512 newly processed prompt tokens and 128 generated tokens respectively, not a single 512-input/128-output application request. Repetitions, statistic, variation, raw timings, exact benchmark invocation, backend, fork/build/commit, thread counts, batch/microbatch, KV types, flash-attention state, existing cache depth and configured maximum context are unreported. The separate Serving section mentions beellama.cpp, llama-swap, the pi coding agent, 180224-token server context and a 131072 pi maxTokens setting. Its server commands, quantized-cache options, tensor splits and speculative/MTP flags must not be assigned to the PP512/TG128 measurements. In particular, 180224 is not a verified benchmark context length. The separate fib column is llama-cli Fibonacci with MTP decode; its 45 t/s is excluded from the native PP/TG headline. Memory and comparability: the GiB value is a model-file size, not measured resident usage. The model-file size being smaller than combined VRAM does not establish full GPU residency or the benchmark split mode; both placement and resident usage remain unreported.