Falcon3

1 report

Falcon3 VRAM requirements by size and quant →

How does Falcon3 run on your hardware?

Pick your GPU or Mac, then read the speeds people reported for Falcon3 on it, or estimate memory fit and speed.

Buying hardware? Compare GPUs →

Free to use. No account needed. Memory estimates and community measurements are labelled separately.

Run Falcon3 yourself? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Benchmark with your agent Paste a result

Reported performance for Falcon3

Filter this model’s reports by setup →

Thin page (1 of 3 reports needed for indexing). Add yours.

Falcon3 1B

Unknown GPU · BitRun

generation:: 98-127 tokens/s

Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is shown only when the source reports it; generation speed cannot tell us time to first token. Check the full setup before comparing.

User reports Falcon3 1B Instruct at 98-127 tokens/sec on an Apple M4 Pro CPU (12 cores), running pure CPU SIMD with 0% GPU usage. Setup is the BitRun runner (patched bitnet.cpp) with a ~1.30 GB GGUF model using ~1.9 GB RAM. The same model runs at 39-45 tokens/sec on an Intel Core i5-12600K (AVX2) with 209.6 t/s prompt processing, and 40-45 tokens/sec on WSL2 with 4 cores. BitNet b1.58 2.4B reaches ~40 tokens/sec and BitNet 70M 1,350+ tokens/sec on the M4 Pro.

Get a weekly email of new Falcon3 reports on any GPU.

Email me new reports