- generation:
- 12.0 tokens/s
- quant:
- Q4
User reports Qwen3.8 27B Q4 at around 12 t/s on a Jetson Thor, below the ~20 t/s they expected from its memory bandwidth. No engine, context length or KV cache is stated; the figure is without MTP or DFlash. On an RTX 5070 Ti the same model reaches about 66 t/s, and DFlash on the Thor gives only a roughly 2x speedup, slightly better than MTP.