Qwen3.8 27B

on NVIDIA RTX 4070 Ti Super · llama.cpp

Sep 7, 2026

Throughput

7.6 t/s gen

Quant

Q4_K_M (GGUF)

KV cache

VRAM reported

12 GB

Use cases

coding

Summary

User reports Qwen 3.8 27B Q4_K_M running on an RTX 4070 Ti Super 12GB and a MacBook M5 Air over RPC with llama.cpp, completing a coding game clone task in 117 minutes. Setup uses llama.cpp over RPC between the two machines. LM Studio is also mentioned. The 117 minutes is the total time for the task, not a throughput figure.

View source ↗