llamaperf

Laguna XS 2.1 / b11146 Vulkan / Sept26 routine PP512 TG128

on AMD Strix Halo 128GB · llama.cpp

AMD hardware
Oct 13, 2026
Throughput
80.4 t/s gen · 1399.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
F16
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

Source: https://github.com/hogeheer499-commits/strix-halo-guide/blob/f5d9e6dac1ec9aeeeeb1165ae85d305b33cee234/data/raw/2026-09-26/64gb-tier-30b-candidates-b11146/README.md Author: hogeheer499-commits. Historical measurement 2026-09-26, recovered 2026-10-13; source snapshot f5d9e6dac1ec9aeeeeb1165ae85d305b33cee234. Raw CSV and JSON, per-run commands and stderr retained. This is routine-load first-party benchmark evidence, not independent reproduction. Hardware: Beelink GTR9 Pro, AMD Ryzen AI Max+ 395 / Radeon 8060S, nominal 128GB unified RAM. Each of the four measured processes explicitly enumerates exactly one Vulkan device, Radeon 8060S; native rows say Vulkan. RPC library being loaded is not RPC participation. Native CPU threads16. Separate May1 hardware audit says16 physical cores/32 threads; these are historical same-host topology, not an active-core measurement in September. GPU CU count unknown. No dedicated VRAM or resident/peak model memory measurement. Runtime: official Ubuntu x64 Vulkan llama.cpp v0.5.0 release asset, executable reports0.5.0-dev build11146 commit7fe450e19, GNU11.4.0. Kernel7.0.0-31, Mesa/RADV26.2.3, AMD_VULKAN_ICD=RADV. All rows use ngl999, FA1, batch2048, ubatch512, F16 K/V, load/lazy auto, devices:auto, main_gpu0, layer split, no CPU MoE override. Host: balanced power, DPMauto, VM/desktop/browser/video-call/remote-access processes active; Ollama empty; preexisting swap nearly full. No strict-clean or causal cross-campaign comparison. Model: Laguna XS 2.1, Q4_K_M; publisher ggml-org; Laguna-XS-2.1-Q4_K_M.gguf. GGUF native type is laguna 30B.A3B Q4_K - Medium, 33.442617088B parameters. Separate code smoke exhausted 1024-token cap and passed with n4096; that is not this synthetic workload. Artifact: pinned HF 273068c9ae4ee6efea803da861aa404d115d3023; 19563570240 disk bytes; SHA256 0a8301bc1b8509b27ed39ec86b98278c03341db6311c065326bd6629cd7304d6. Source's local hash and byte count match independently retrieved pinned HF metadata. Actual tested bytes remain author-attested; no weight download or independent rehash. Native model_size=19559844864 is tensor storage, not disk file size or residency. HF: https://huggingface.co/ggml-org/Laguna-XS-2.1-GGUF/blob/273068c9ae4ee6efea803da861aa404d115d3023/Laguna-XS-2.1-Q4_K_M.gguf Native rows (mean +/- sample SD; pass2 is a distinct repeated control, not pooled or best-of): - Pass 1 pp512, prepared depth 0, r10: 1399.017430 +/- 9.822885 t/s; mean native duration 365987368 ns. - Pass 1 tg128, prepared depth 0, r10: 80.446103 +/- 0.116181 t/s; mean native duration 1591130400 ns. - Pass 2 pp512, prepared depth 0, r10: 1385.834889 +/- 9.886393 t/s; mean native duration 369469348 ns. - Pass 2 tg128, prepared depth 0, r10: 80.312458 +/- 0.540978 t/s; mean native duration 1593841291 ns. - Pass 1 pp8192, prepared depth 0, r3: 1026.839530 +/- 0.519353 t/s; mean native duration 7977878875 ns. - Pass 1 tg128, prepared depth 8192, r3: 70.052156 +/- 0.037432 t/s; mean native duration 1827210360 ns. The headline pair is pass1 PP512/TG128. Separate synthetic tests, not a512-input/128-output chat request. Exact commit's llama-bench timer inspected: load, context creation, warmup and depth preparation precede timing; PP processes random token batches and synchronizes; TG does128 single-token decode calls with synchronization. Numerator is n_prompt+n_gen, not useful natural-language output. The depth8192 TG test preloads/restores8192 tokens outside timing, then measures128 new decode steps. PP8192 starts at depth0. Requested n_ctx is512/128/8192/8320 per corresponding shape; effective allocated capacity is not logged and stays unknown. Native durations are not TTFT. Measured TTFT unknown; no reciprocal-rate or prompt/time proxy supplied. No server/client rate, concurrency, speculation or quality inference imported. Timer: https://github.com/ggml-org/llama.cpp/blob/7fe450e19/tools/llama-bench/llama-bench.cpp LlamaPerf numeric fields are rounded to the supported 0.1 tok/s step; exact source means and standard deviations are retained above.