llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 4070 · Unsloth Desktop · 120,000 ctx

NVIDIA hardware
Sep 26, 2026
Throughput
20-40 t/s gen

Use cases

codingagentic

Summary

User asks for advice on orchestrating a local Qwen 3.8 27B GGUF model with cloud subscriptions (Claude, Codex, Antigravity) to avoid burning paid tokens. Setup is Unsloth Desktop on a remote rig with dual GPUs (RTX 4070 + RTX 5060 Ti), tunneled through Cloudflare, with a 120k context window. User reports output of around 20–40 tokens/s.