Qwen3.6 35B (3B active)
on 2× NVIDIA P102-100 · llama.cpp · 32,768 ctx
Summary
User reports Qwen3.6-35B-A3B at 23.49 tokens per second per user with 3 concurrent users on two NVIDIA P102-100 cards of 10 GB each.
Setup is llama.cpp server with the UD-IQ4_XS GGUF, all layers on the two cards, 96K context giving 32K to each user, with prompt processing at 432.28 tokens per second.
The user gives the end result as 70tk/s and 1,257 PP across the three users, from $100 worth of cards.