Oct 13, 2026
Summary
Qwen3.6-27B-MTP Q4_K_M native PP/TG
Headline is native raw PP512 333.95±7.08 / TG128 12.05±0.03, plus PP64 240.26±22.23 / TG64 12.00±0.05. The method states 3 repetitions; raw logs confirm FA on, mmap off and requested ngl 999. This is raw inference without speculative decoding. The separate CLI MTP attempt hung with 0% GPU and was killed; it supplies no measured result. A third-party 20 tokens/s claim and source's implied 1.67x speculation estimate are excluded. Tested local filename Qwen3.6-27B-MTP-Q4_K_M.gguf is visible in the failed b867 log and adjacent method; successful model label has 27.32 B parameters and 15.92 GiB tensor size. Source says downloads were from unsloth. Current reference repo unsloth/Qwen3.6-27B-MTP-GGUF contains Qwen3.6-27B-Q4_K_M.gguf, lacking -MTP in filename. Thus HF is a model/quantization reference only, not an exact-filename or byte-identity match. Do not claim that current file hash was tested. Exact measured engine short hash 39cf5d6 is in both successful logs; matching upstream timer source was read. Source calls runtime lemonade b1270, while raw build counter is 1; preserve both instead of substituting upstream release numbers.
Historical source-reported native llama-bench measurements by Paul Durkin / NorthstarAurora / h34v3nzc0dex. Evidence dataset revision 4c24348922a9f2ff7e481956c0eb08fa28284227; guide snapshot 46d062142eae35e36f0c1d0d91b393b59724432a. These are evidence snapshots, not engine or tested-model revisions. Exact measurement date is unpublished; the dataset existed by 2026-05-25. No new benchmark was run.
Corsair AI Workstation 300, Ryzen AI MAX+ 395 / Radeon 8060S gfx1151, nominal 128 GB unified LPDDR5X-8000. Every retained raw log explicitly enumerates found 1 ROCm/Vulkan device and device 0, then shows that backend and positive GPU-layer offload. Thus participating physical GPU quantity = 1 per arm. Alternate ROCm/Vulkan builds run on the same APU, not two GPUs. Source also labels memory 128 GiB; retain nominal 128 GB SKU and source units, without claiming measured physical byte capacity. 131072 MiB reported ROCm VRAM is unified exposed capacity, not dedicated VRAM or resident weight memory. CPU thread count, native resident memory, measured CPU/GPU core counts and concurrency are not established by these logs.
PP and TG are separate fixed-work synthetic tests, not one chat request. PP64/PP512 token counts are actual llama_decode input work; TG64/TG128 makes 64/128 single-token decode calls, without EOS-driven text sampling. These logs have no nonzero depth suffix; native test labels indicate depth 0. No 2048-token or deep-context test is attributed to this 27B campaign. Native timers use std::chrono high_resolution_clock nanoseconds. Load/context setup, warmup, per-repetition memory clearing precede timing. The implementation can populate depth before timing, but these 27B tests have depth 0. Timed functions include host token construction and llama_decode; PP synchronizes after its batches and TG synchronizes each token. Per-repetition rate is 1e9*(n_prompt+n_gen)/elapsed_ns; reported values are mean and sample SD of rates over 3 stated repetitions. The source initializes demand as n_prompt+n_gen+n_depth, but may reuse a larger context; actual allocation request and rounded capacity are unknown. No tokenization, HTTP/client timing or measured TTFT is provided; TTFT remains blank. No prompt_tokens/rate proxy is used. Native batch/KV settings are not in compact logs. Checked engine source defaults are batch 2048, ubatch 512, F16 KV, but defaults are not recorded run fields and remain reference-only. Requested offload 99/999 is not a verified number of model layers.
HF links identify current reference metadata. Historical tested revision and hash remain unknown. Rounded native model tensor-storage size is neither disk file bytes nor measured resident memory. No weights were downloaded; no source software was executed.
Raw rows (tokens/s mean±SD; d denotes preinitialized depth):
qwen36-bench/bench-qwen36-27b-mtp-raw-pp512-tg128-lemonade-b1270.log
FA 1 pp512 333.95±7.08; FA 1 tg128 12.05±0.03
qwen36-bench/bench-qwen36-27b-mtp-raw-pp64-tg64-lemonade-b1270.log
FA 1 pp64 240.26±22.23; FA 1 tg64 12.0±0.05
Sources:
https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/qwen36-bench/bench-qwen36-27b-mtp-raw-pp512-tg128-lemonade-b1270.log
https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/qwen36-bench/bench-qwen36-27b-mtp-raw-pp64-tg64-lemonade-b1270.log
https://github.com/h34v3nzc0dex/strix-halo-llm-finetune-guide/blob/46d062142eae35e36f0c1d0d91b393b59724432a/qwen36-bench/README.md
https://huggingface.co/unsloth/Qwen3.6-27B-MTP-GGUF/blob/5cb35eb3dcbf52dbce5f87dbc64df6aaffadcace/Qwen3.6-27B-Q4_K_M.gguf
Source QA: Compact logs start with device enumeration, not the command, despite the dataset card saying the first non-comment line is the command. Command shapes and repetitions come from the linked campaign guide and bench script. Raw build hashes are distinguished from guide release labels. No Zen 5c claim is copied from the dataset card.
Timer source matching reported engine hash: https://github.com/ggml-org/llama.cpp/blob/39cf5d6/tools/llama-bench/llama-bench.cpp
Hardware source: https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/README.md
LlamaPerf structured rates are rounded to 0.1 tokens/s to match form precision; exact native means and SDs are retained above.