Falcon3 1B
on Unknown GPU · BitRun
Oct 14, 2026
Summary
User reports Falcon3 1B Instruct at 98-127 tokens/sec on an Apple M4 Pro CPU (12 cores), running pure CPU SIMD with 0% GPU usage.
Setup is the BitRun runner (patched bitnet.cpp) with a ~1.30 GB GGUF model using ~1.9 GB RAM.
The same model runs at 39-45 tokens/sec on an Intel Core i5-12600K (AVX2) with 209.6 t/s prompt processing, and 40-45 tokens/sec on WSL2 with 4 cores. BitNet b1.58 2.4B reaches ~40 tokens/sec and BitNet 70M 1,350+ tokens/sec on the M4 Pro.