llamaperf

Qwen3.8 27B Swift-1.5

on NVIDIA Tesla P100 16GB · Strata · 131,072 ctx

Tone: positiveNVIDIA hardware
Oct 25, 2026
Throughput
30.0 t/s gen
System RAM
64 GB
VRAM reported
16 GB

Use cases

agentictool-use

Summary

User reports about 30 tok/s with the Swift-1.5 version of Qwen3.8 Flash-Next on a Tesla P100 16GB in a PCIe3 x16 slot, after switching from llama.cpp to Strata. Setup is Strata with 64GB of ECC DDR4 at 2100 and a 131072-token context; the logs show expert cache hits of 63.5% to 77.8% with routed experts going over PCIe, so part of the model ran from system RAM. Individual runs in the pasted logs range from 28.7 to 33.3 tok/s on prompts of roughly 78k tokens, which were read in 2 to 3 s. The user says it serves their Hermes agent and calls it impeccable for a local LLM.