HobbyLM 0.5B
on 8× NVIDIA H200
Summary
User pretrained a 500M parameter LLM and a 330M image generator from scratch on 8xH200 from modal.com.
The total cost was $800, and GGUF weights are included.
User mentions pretraining a 1B model next.
on 8× NVIDIA H200