Shoehorn, a library to quantize an LLM to fit your Mac's VRAM

Shoehorn is an open-source Python library that quantizes large language models to fit within the available VRAM on Apple Mac hardware. It automates the process of selecting an appropriate quantization level so the model can run locally without exceeding memory limits. The library is intended for developers who want to run LLMs on consumer Mac machines without manual configuration.