Llama 3.2 1B

User benchmarks Llama 3.2 1B at 14.62 tok/s generation and 108.11 tok/s prompt processing on an Orange Pi 5 Plus (RK3588, 16GB LPDDR4x) using Ollama with 4 threads pinned to the Cortex-A76 big cores. Setup is Ollama with Q4_K_M GGUF weights, CPU-only inference; the same board also ran DeepSeek-Coder 1.3B at 16.90 tok/s, Qwen 2.5 1.5B at 14.48 tok/s, Llama 3.2 3B at 7.28 tok/s, Phi-3 Mini 3.8B at 6.56 tok/s and Llama 3.1 8B at 2.32 tok/s, all with 4 threads. Core pinning to 4 big cores gave up to +318% over the default 8 threads; the 8B model hit 85.0°C uncooled and the NPU path (RKLLM runtime) reached 21.55 tok/s on Qwen 1.5 0.5B with ~0% CPU load.