Qwen3.6 35B (3B active)
on Unknown GPU · llama.cpp
Summary
User reports running Qwen3.6 35B A3B with MTP on a gaming laptop with 8GB VRAM, averaging about 5-8 t/s for the first 50k of context and dipping to 3-5 t/s for 50-100k before auto-compacting.
Setup is llama.cpp with a GGUF quant and a custom web UI built on top of it; the model is partially offloaded to system RAM.
The user says the speed is acceptable and they do other things while it runs, describing it as a fun local LLM project.