Llama 7B
on M1 Max 64GB · LM Studio
Use cases
codingvisionlong-context
Summary
User reports about 45 tokens/sec on a 7B Llama model in MLX on an M1 Max 64GB, but finds 7B too limited for most tasks.
Setup is LM Studio; the user also tried a 32B Qwen model there and hit errors.
User asks which models suit offline research, legal and medical analysis, light coding, CAD/PCB, Blender and image generation, and is looking to move up to 32B, 70B and 120B models.