User reports a crystallization experiment on Qwen2.5-7B-Instruct using an activation-steering engine called AkbasCore 3.0 / SEASC on 1× NVIDIA A100-SXM4-40GB. Setup uses LoRA gradient updates to transfer part of the induced layerwise representation geometry into the model weights, then removes the runtime steering motor and adapter. Training ran 1.549 min (~93 seconds) and consumed 2.6329 Wh of measured GPU-board energy at a time-weighted mean board power of 102.33 W. The locked final test showed +15.7881% progress with the motor off, best state at update 40, and automatic overshoot detection at update 70. An unresolved merge diagnostic reports 1.762% relative hidden-state drift.
Local model performance on your hardware
Find which open-weight LLMs fit in your GPU or Mac and compare the speeds people report on setups like yours.
Join the community
What runs on your hardware?
Pick your GPU or Mac, then read the speeds people reported on it, or estimate which models fit and how fast they run.
Free to use. No account needed. Memory estimates and community measurements are labelled separately.
Looking for a particular model?
Search for a model to see its reported speeds across GPUs and Macs.
Local model performance reports from the community
These are individual setups, not a controlled benchmark. Compare GPU count, quantization, context and offloading before comparing speeds. How to read a report →
GPU: NVIDIA A100 40GB
Compare setup details
Exact recorded values. Context may be a configured limit; matching filters does not establish identical prompts, offloading or concurrency.
- generation:
- 16.1 tokens/s
- quant:
- Q8_K_XL (GGUF)
User reports all experts on CPU with only 15.8 GB of 40 GB VRAM used.
Showing 1–2 of 2
Page 1 of 1
Community benchmarks snapshot
Records by GPU
Records by model
Qwen3.81274
Qwen3.6284
Gemma 4168
DeepSeek V4 Flash149
Qwen3.5121
Qwen375
other629
Records by engine
llama.cpp1008
vLLM206
Strata150
MLX106
Ollama83
other428
Use cases
coding 739agentic 467long-context 342tool-use 207vision 137summarization 61math 58creative-writing 46multilingual 29rp 13text-generation 9reasoning 3
Median generation t/s by GPU
On Qwen3.8 27B at 4-bit, plain single-GPU runs. Full ranking