Qwen3.8 27B
on Unknown GPU · llama.cpp · 262,144 ctx
Use cases
agentic
Summary
User reports Qwen3.8-27B running on a 16 GB card at 262,144 context.
Setup is buun's llama.cpp fork with the GSQ IQ3_XXS quant and a VBR KV cache.
The user describes the setup as intended for agentic use.