Download the model
once. Keep the recipe.
By Alvin
Read the model license before downloading; the weights and engine have separate terms. We use source revision 7b60076 and model revision 2d80116, matching our November 14 experiment. [37] [38] [39]
python3 edge_workshop.py doctor
Doctor prints Ready for each required tool and reports disk space. Resolve Needs attention lines first. A missing model folder or executable is expected before a first installation. Close memory-heavy work before loading this large model.
Run each phase and wait for the prompt
python3 setup_edge0.py prepare --out my-install python3 setup_edge0.py weights --out my-install
prepare obtains the engine source, math dependency, Apple’s Metal headers and model-file list. weights downloads and fingerprints the selected Q3_K weights with Q4 projection files. Installation needs internet access; later requests use the local engine.
Both phases save records in my-install. Wait for success: true and the Terminal prompt. Files go in Models / Edge0-CAC-20261114 inside your home folder. A first download may take hours; rerunning weights reuses matching files and can resume partial transfers.