So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...

After much testing, I want to document the only working path I found for Dolphin on Mac (Apple Silicon), with all the dependency, dtype, and torch quirks. This may help users (and maybe even you, the ...