Use cases
coding
Summary
User reports a local model reaching 100% on an SQL benchmark, running on dual RTX 3080 20GB cards with 96GB RAM and a 9800X3D.
Setup is a custom IQ2_M GGUF with grafted tensors from antirez GGUF, running on a modified ds4 engine.
Mainline llama.cpp gives 100pp and 8tg.