Qwen3.8 27B

User reports a repository of launcher scripts for running local LLMs on the 128 GB Jetson AGX Thor Developer Kit, with vLLM or NVIDIA's Thor-optimized llama.cpp container. The default profile is Qwen3.8-27B NVFP4 with DFlash2 speculative decoding, a 30.3 GB download, listed at a published 27.69-34.44 tok/s on Thor. Other profiles include Qwen3.6-35B-A3B NVFP4 + DFlash at 116.5 average and 139.1 peak tok/s, Nemotron Nano 9B v2 NVFP4 at 30 tok/s, Nemotron 3.5 Lightning NVFP4 + DSpark at 123.01-138.02 tok/s, Gemma 4 26B-A4B NVFP4 + MTP at 50 tok/s c1 and 180 tok/s aggregate c8, and Muse Glimmer 30B K-Quant + DFlash at up to 36 tok/s. The GLM-4.7-Flash and GLM-4.5-Air profiles are experimental with no published Thor speeds. The speeds come from different workloads and are not a controlled comparison.