mlx-optiq Local Models

Guides you through running a quantized language model on your own Apple Silicon Mac with mlx-optiq. The workflow checks your Mac's memory, checks that mlx-optiq is installed (and points you to the install steps if it is not, without installing anything itself), helps you pick a model that fits, and, once you confirm the download, starts it with optiq serve as a local chat-completions endpoint. It shows how to connect a client to that endpoint, run a quick speed and quality check, and troubleshoot common problems such as running out of memory. It states the limits plainly: KV-cache quantization saves memory but can slow decoding, long contexts need memory, and quantized models should be checked on your own tasks instead of trusting speed numbers. This plugin contains instructions only; everything runs on your own machine.