Set up your local AI model (Runtime)
5 min · 4 steps
Pick + install a Small Language Model — Avery's Runtime profile uses local by default.
Avery splits AI into two profiles. Runtime (what runs your agents) is local-by-default — pick a Small Language Model and Avery runs every agent node against it on your machine. Build (what generates agents + apps from prompts) is cloud-only — see the 'Connect a cloud provider' article. The first-run wizard probes your hardware (RAM, GPU, OS) and recommends a Runtime variant.
Steps
- Open Settings → AI → AI Model for Runtime.
Or the first-run wizard if this is a fresh install. The 'Local' option in the mode toggle picks your installed SLM.
- Pick a variant.
Avery filters the catalog to variants that fit your hardware tier. The recommended one is at the top.
- Click 'Install'.
Streams the model files (3-8 GB depending on quantisation). Once done, Avery smoke-tests the install with a tiny prompt.
- Set as active.
Mark the new model as the default for Runtime `/llm.*` requests.
Live recipes need the desktop
This article is a static preview. The in-app Help sidecar inside Avery NXR can fire each step against your live project — install the desktop to use it interactively.