Applications
Meta has released Muse Glimmer, an agent-based model with 30 billion parameters that can run on a single consumer-grade GPU
Thanks to 4-bit quantisation, Meta is able to fit a complete agentic model into 18 to 20 GB of VRAM, making it usable on a standard PC or Mac fitted with a consumer-grade graphics card.