Oct 13, 2026
Summary
Qwen3.6-35B-A3B BF16 native PP/TG
Headline is ROCm FA=1 shape 1, PP512 484.01±4.40 and TG128 21.51±0.00. Separate shape 2 at depth 0 yields PP2048 474.69±2.76 and TG128 23.71±0.01. Do not mix shape 1 prefill with shape 2 generation. Vulkan shape 1 is PP512 305.21±0.87 / TG128 10.74±0.00; its depth-sweep TG128 at d0 is 10.73±0.00. Zero SD is the source's rounded display, not proof of noiseless timing. Both BF16 backends report a497476 (1), matched by source method b9296. Source reproduction names unsloth/Qwen3.6-35B-A3B-GGUF and first shard BF16/Qwen3.6-35B-A3B-BF16-00001-of-00002.gguf; current pinned reference includes both shards. Native tensor size 64.60 GiB and params 34.66 B are not measured resident memory. Do not claim Vulkan native BF16 compute from BF16 weight storage: measured capability explicitly reports bf16:0.
Historical source-reported native llama-bench measurements by Paul Durkin / NorthstarAurora / h34v3nzc0dex. Evidence dataset revision 4c24348922a9f2ff7e481956c0eb08fa28284227; guide snapshot 46d062142eae35e36f0c1d0d91b393b59724432a. These are evidence snapshots, not engine or tested-model revisions. Exact measurement date is unpublished; the dataset existed by 2026-05-25. No new benchmark was run.
Corsair AI Workstation 300, Ryzen AI MAX+ 395 / Radeon 8060S gfx1151, nominal 128 GB unified LPDDR5X-8000. Every retained raw log explicitly enumerates found 1 ROCm/Vulkan device and device 0, then shows that backend and positive GPU-layer offload. Thus participating physical GPU quantity = 1 per arm. Alternate ROCm/Vulkan builds run on the same APU, not two GPUs. Source also labels memory 128 GiB; retain nominal 128 GB SKU and source units, without claiming measured physical byte capacity. 131072 MiB reported ROCm VRAM is unified exposed capacity, not dedicated VRAM or resident weight memory. CPU thread count, native resident memory, measured CPU/GPU core counts and concurrency are not established by these logs.
PP and TG are separate fixed-work synthetic tests, not one chat request. PP512/PP2048 token counts are actual llama_decode input work; TG128 makes 128 single-token decode calls, without EOS-driven text sampling. Depth 0/4196/8392 is context populated before the timer, not new prompt tokens or capacity. Native timers use std::chrono high_resolution_clock nanoseconds. Load/context setup, warmup, per-repetition memory clearing and depth setup or restored depth cache precede timing. Timed functions include host token construction and llama_decode; PP synchronizes after its batches and TG synchronizes each token. Per-repetition rate is 1e9*(n_prompt+n_gen)/elapsed_ns; reported values are mean and sample SD of rates over 3 stated repetitions. The source initializes demand as n_prompt+n_gen+n_depth, but may reuse a larger context; actual allocation request and rounded capacity are unknown. No tokenization, HTTP/client timing or measured TTFT is provided; TTFT remains blank. No prompt_tokens/rate proxy is used. Native batch/KV settings are not in compact logs. Checked engine source defaults are batch 2048, ubatch 512, F16 KV, but defaults are not recorded run fields and remain reference-only. Requested offload 99/999 is not a verified number of model layers.
HF links identify current reference metadata. Historical tested revision and hash remain unknown. Rounded native model tensor-storage size is neither disk file bytes nor measured resident memory. No weights were downloaded; no source software was executed.
Raw rows (tokens/s mean±SD; d denotes preinitialized depth):
vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-rocm-shape1.log
FA 0 pp512 479.55±1.69; FA 0 tg128 21.48±0.01; FA 1 pp512 484.01±4.4; FA 1 tg128 21.51±0.0
vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-rocm-shape2.log
FA 1 pp2048 474.69±2.76; FA 1 tg128 23.71±0.01; FA 1 pp2048 @ d4196 458.15±2.35; FA 1 tg128 @ d4196 23.39±0.01; FA 1 pp2048 @ d8392 440.02±0.67; FA 1 tg128 @ d8392 23.09±0.0
vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-vulkan-shape1.log
FA 0 pp512 306.85±1.0; FA 0 tg128 10.74±0.0; FA 1 pp512 305.21±0.87; FA 1 tg128 10.74±0.0
vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-vulkan-shape2.log
FA 1 pp2048 307.44±1.28; FA 1 tg128 10.73±0.0; FA 1 pp2048 @ d4196 291.88±1.28; FA 1 tg128 @ d4196 10.68±0.01; FA 1 pp2048 @ d8392 289.64±0.84; FA 1 tg128 @ d8392 10.64±0.0
Sources:
https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-rocm-shape1.log
https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-rocm-shape2.log
https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-vulkan-shape1.log
https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/vulkan-vs-rocm-sweep/bench-qwen36-a3b-bf16-vulkan-shape2.log
https://github.com/h34v3nzc0dex/strix-halo-llm-finetune-guide/blob/46d062142eae35e36f0c1d0d91b393b59724432a/vulkan-vs-rocm-sweep/README.md
https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/blob/a483e9e6cbd595906af30beda3187c2663a1118c/BF16/Qwen3.6-35B-A3B-BF16-00001-of-00002.gguf
Source QA: Compact logs start with device enumeration, not the command, despite the dataset card saying the first non-comment line is the command. Command shapes and repetitions come from the linked campaign guide and bench script. Raw build hashes are distinguished from guide release labels. No Zen 5c claim is copied from the dataset card.
Timer source matching reported engine hash: https://github.com/ggml-org/llama.cpp/blob/a497476/tools/llama-bench/llama-bench.cpp
Hardware source: https://huggingface.co/datasets/NorthstarAurora/strix-halo-bench-data/blob/4c24348922a9f2ff7e481956c0eb08fa28284227/README.md
BF16 companion shard reference: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/blob/a483e9e6cbd595906af30beda3187c2663a1118c/BF16/Qwen3.6-35B-A3B-BF16-00002-of-00002.gguf
LlamaPerf structured rates are rounded to 0.1 tokens/s to match form precision; exact native means and SDs are retained above.