Qwen3.8 27B
on NVIDIA RTX 3090 · llama.cpp
Use cases
agentic
Summary
User reports Qwen3.8-27B at ~70 tok/s on a single RTX 3090 with 24 GB, using 4-bit inference via llama.cpp.
The model is used for trading decisions, with QLoRA training and Ollama mentioned as a potential engine for distributed inference.
User is calling for contributors to an LLM trading experiment.