Outlier · Local AI for Mac

What AI models can a Mac with 24 GB run?

Quick answer
  • A Mac with 24 GB fits 19 models for short chats, 16 for long 32,000-token work, from 33 models in our list. We use measured minimums where available and our cautious rule for the rest.
  • For long work, the roomiest fit is Qwen3.5-4B. It has the lowest listed memory floor, 6 GB, leaving 18 GB above that floor.
  • For long work, the smallest fit by parameter count is Qwen2.5-0.5B-Instruct, listed as 0.5B dense. It takes 0.28 GB on disk. The largest fit by parameter count is Qwen3.8-27B, listed as 27B dense.

Every model that fits

The short-chat column can open up choices that need more memory for long work. All balances and larger-Mac suggestions here follow the long-work column. Where we have a measurement, that result fills both columns.

At this capacity, check the newly admitted models before assuming the whole fit list has changed. The transition paragraph names the additions from the previous memory size. Models already admitted keep their listed floors and gain room above them. That extra room is visible in the memory-left column, so you can compare an existing small model with a new candidate on the same basis.

The representative speed columns sample different points in this fit list. Find the Mac name first, then follow the model heading across. A measured reference can support estimates for other chips. Each cell keeps the calculator wording available so the evidence stays attached to the rate. A range needs that source when comparing machines with different memory bandwidth.

For a download decision, put the storage requirement beside the available disk space on your Mac. For a running decision, use the source memory minimum and the context warning. These checks answer separate practical questions. The table of excluded models shows how far each candidate sits above this tier and where a larger listed configuration would admit it. Use those individual targets to plan a change in hardware.

Compared with the 16 GB memory page, this size adds 6 models. The added models are Mistral-7B-Instruct-v0.3, Meta-Llama-3.1-8B-Instruct, Qwen3-8B, gpt-oss-20b, Qwen3.6-27B, Qwen3.8-27B. Models already below the earlier limit gain more space above their minimum. The chip changes the speed shown below, while the fit list follows the same memory test.

Models that fit long work, with measured minimums used where available
ModelFitShort chatsLong 32,000-token work Memory left for long workDisk
Qwen2.5-0.5B-Instruct fits 8 GB 8 GB 16 GB 0.28 GB
Qwen3-0.6B fits 8 GB 16 GB 8 GB 0.34 GB
Qwen3.5-0.8B fits 8 GB 8 GB 16 GB 0.63 GB
Llama-3.2-1B-Instruct fits 8 GB 8 GB 16 GB 0.7 GB
Qwen3-4B-Instruct-2507 fits 16 GB 16 GB 8 GB 2.26 GB
Qwen3.5-4B fits 6 GB measured 6 GB measured 18 GB 2.37 GB
gemma-3-4b-it-qat fits 16 GB 16 GB 8 GB 3 GB
Mistral-7B-Instruct-v0.3 fits 16 GB 18 GB 6 GB 4.08 GB
Qwen2.5-Coder-7B-Instruct fits 16 GB 16 GB 8 GB 4.28 GB
Meta-Llama-3.1-8B-Instruct fits 16 GB 18 GB 6 GB 4.52 GB
Qwen3-8B tight 16 GB 24 GB 0 GB 4.61 GB
Qwen3.5-9B fits 12 GB measured 12 GB measured 12 GB 5.04 GB
gpt-oss-20b tight 24 GB 24 GB 0 GB 11.18 GB
Gemma-4-26B-a4b-it fits 16 GB measured 16 GB measured 8 GB 15.61 GB
Qwen3.6-27B tight 24 GB measured 24 GB measured 0 GB 15.13 GB
Qwen3.8-27B tight 24 GB measured 24 GB measured 0 GB 15.5 GB

Speed table by chip

The table covers all 20 Mac models sold with 24 GB in our Mac list, including older models. Each row names the exact Mac and chip. The representative models are Qwen3.5-4B, Qwen2.5-0.5B-Instruct, Qwen3.8-27B, Qwen2.5-Coder-7B-Instruct. They cover the roomiest fit, the smallest model, the largest model and the middle of this fit list, with repeated names removed.

Speed by chip for every Mac listed with 24 GB
Mac and chipQwen3.5-4BQwen2.5-0.5B-InstructQwen3.8-27BQwen2.5-Coder-7B-Instruct
MacBook Air M2Apple M2 about 7.2 to 21 tokens/s estimate, not measured by us
How we estimate speed 7.17 to 20.94 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 71 to 143 tokens/s estimate, not measured by us
How we estimate speed 71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
about 1.7 to 5.0 tokens/s estimate, not measured by us
How we estimate speed 1.72 to 5.03 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 4.7 to 9.3 tokens/s estimate, not measured by us
How we estimate speed 4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
MacBook Pro 13 M2Apple M2 about 7.2 to 21 tokens/s estimate, not measured by us
How we estimate speed 7.17 to 20.94 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 71 to 143 tokens/s estimate, not measured by us
How we estimate speed 71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
about 1.7 to 5.0 tokens/s estimate, not measured by us
How we estimate speed 1.72 to 5.03 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 4.7 to 9.3 tokens/s estimate, not measured by us
How we estimate speed 4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
Mac mini M2Apple M2 about 7.2 to 21 tokens/s estimate, not measured by us
How we estimate speed 7.17 to 20.94 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 71 to 143 tokens/s estimate, not measured by us
How we estimate speed 71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
about 1.7 to 5.0 tokens/s estimate, not measured by us
How we estimate speed 1.72 to 5.03 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 4.7 to 9.3 tokens/s estimate, not measured by us
How we estimate speed 4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
MacBook Air 13 M3Apple M3 about 7.2 to 20 tokens/s estimate, not measured by us
How we estimate speed 7.17 to 20.44 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 71 to 143 tokens/s estimate, not measured by us
How we estimate speed 71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
about 1.7 to 4.9 tokens/s estimate, not measured by us
How we estimate speed 1.72 to 4.91 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 4.7 to 9.3 tokens/s estimate, not measured by us
How we estimate speed 4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
MacBook Air 15 M3Apple M3 about 7.2 to 20 tokens/s estimate, not measured by us
How we estimate speed 7.17 to 20.44 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 71 to 143 tokens/s estimate, not measured by us
How we estimate speed 71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
about 1.7 to 4.9 tokens/s estimate, not measured by us
How we estimate speed 1.72 to 4.91 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 4.7 to 9.3 tokens/s estimate, not measured by us
How we estimate speed 4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
iMac M3Apple M3 about 7.2 to 20 tokens/s estimate, not measured by us
How we estimate speed 7.17 to 20.44 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 71 to 143 tokens/s estimate, not measured by us
How we estimate speed 71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
about 1.7 to 4.9 tokens/s estimate, not measured by us
How we estimate speed 1.72 to 4.91 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 4.7 to 9.3 tokens/s estimate, not measured by us
How we estimate speed 4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB
MacBook Pro 14 M4Apple M4 about 8.6 to 23 tokens/s estimate, not measured by us
How we estimate speed 8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 86 to 171 tokens/s estimate, not measured by us
How we estimate speed 85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
about 2.1 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 5.6 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
iMac M4Apple M4 about 8.6 to 23 tokens/s estimate, not measured by us
How we estimate speed 8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 86 to 171 tokens/s estimate, not measured by us
How we estimate speed 85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
about 2.1 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 5.6 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
Mac mini M4Apple M4 about 8.6 to 23 tokens/s estimate, not measured by us
How we estimate speed 8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 86 to 171 tokens/s estimate, not measured by us
How we estimate speed 85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
about 2.1 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 5.6 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
Mac mini M4 ProApple M4 Pro about 20 to 49 tokens/s estimate, not measured by us
How we estimate speed 19.57 to 48.55 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 195 to 390 tokens/s estimate, not measured by us
How we estimate speed 195 to 390 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB
about 4.7 to 12 tokens/s estimate, not measured by us
How we estimate speed 4.69 to 11.65 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 13 to 26 tokens/s estimate, not measured by us
How we estimate speed 12.75 to 25.52 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB
MacBook Pro M4 ProApple M4 Pro about 20 to 49 tokens/s estimate, not measured by us
How we estimate speed 19.57 to 48.55 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 195 to 390 tokens/s estimate, not measured by us
How we estimate speed 195 to 390 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB
about 4.7 to 12 tokens/s estimate, not measured by us
How we estimate speed 4.69 to 11.65 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 13 to 26 tokens/s estimate, not measured by us
How we estimate speed 12.75 to 25.52 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB
MacBook Air 13 M4Apple M4 about 8.6 to 23 tokens/s estimate, not measured by us
How we estimate speed 8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 86 to 171 tokens/s estimate, not measured by us
How we estimate speed 85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
about 2.1 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 5.6 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
MacBook Air 15 M4Apple M4 about 8.6 to 23 tokens/s estimate, not measured by us
How we estimate speed 8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 86 to 171 tokens/s estimate, not measured by us
How we estimate speed 85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
about 2.1 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 5.6 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB
MacBook Air 13 M5Apple M5 about 11 to 23 tokens/s estimate, not measured by us
How we estimate speed 10.97 to 22.95 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 109 to 219 tokens/s estimate, not measured by us
How we estimate speed 109.28 to 218.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB
about 2.6 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.63 to 5.51 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 7.1 to 14 tokens/s estimate, not measured by us
How we estimate speed 7.14 to 14.3 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB
MacBook Air 15 M5Apple M5 about 11 to 23 tokens/s estimate, not measured by us
How we estimate speed 10.97 to 22.95 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 109 to 219 tokens/s estimate, not measured by us
How we estimate speed 109.28 to 218.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB
about 2.6 to 5.5 tokens/s estimate, not measured by us
How we estimate speed 2.63 to 5.51 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 7.1 to 14 tokens/s estimate, not measured by us
How we estimate speed 7.14 to 14.3 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB
MacBook Pro 14 M6Apple M6 about 11 to 26 tokens/s estimate, not measured by us
How we estimate speed 10.97 to 25.75 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 109 to 243 tokens/s estimate, not measured by us
How we estimate speed 109.28 to 242.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB
about 2.6 to 6.2 tokens/s estimate, not measured by us
How we estimate speed 2.63 to 6.18 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 7.1 to 16 tokens/s estimate, not measured by us
How we estimate speed 7.14 to 15.89 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB
MacBook Pro M5 ProApple M5 Pro about 22 to 48 tokens/s estimate, not measured by us
How we estimate speed 22.01 to 47.76 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 219 to 439 tokens/s estimate, not measured by us
How we estimate speed 219.28 to 438.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB
about 5.3 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.28 to 11.46 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 14 to 29 tokens/s estimate, not measured by us
How we estimate speed 14.34 to 28.7 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB
Mac mini M6Apple M6 about 11 to 26 tokens/s estimate, not measured by us
How we estimate speed 10.97 to 25.75 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 109 to 243 tokens/s estimate, not measured by us
How we estimate speed 109.28 to 242.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB
about 2.6 to 6.2 tokens/s estimate, not measured by us
How we estimate speed 2.63 to 6.18 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 7.1 to 16 tokens/s estimate, not measured by us
How we estimate speed 7.14 to 15.89 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB
Mac mini M5 ProApple M5 Pro about 22 to 48 tokens/s estimate, not measured by us
How we estimate speed 22.01 to 47.76 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 219 to 439 tokens/s estimate, not measured by us
How we estimate speed 219.28 to 438.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB
about 5.3 to 11 tokens/s estimate, not measured by us
How we estimate speed 5.28 to 11.46 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 14 to 29 tokens/s estimate, not measured by us
How we estimate speed 14.34 to 28.7 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB
iMac M6Apple M6 about 11 to 26 tokens/s estimate, not measured by us
How we estimate speed 10.97 to 25.75 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s
about 109 to 243 tokens/s estimate, not measured by us
How we estimate speed 109.28 to 242.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB
about 2.6 to 6.2 tokens/s estimate, not measured by us
How we estimate speed 2.63 to 6.18 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s
about 7.1 to 16 tokens/s estimate, not measured by us
How we estimate speed 7.14 to 15.89 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB

What does not fit, and the next memory size

17 models exceed 24 GB for long work.

The next listed memory size is 32 GB. It admits 2 more models from this table. Those models are phi-4, Qwen3-14B. The last column below gives the next suitable size for each excluded model, including sizes outside these memory guides.

Models needing more memory for long work, with their short-chat minimums alongside
ModelShort chatsLong 32,000-token work Memory short for long workNext listed memory
gemma-3-12b-it-qat 24 GB 48 GB 24 GB 48 GB
phi-4 24 GB 32 GB 8 GB 32 GB
Qwen3-14B 24 GB 32 GB 8 GB 32 GB
Mistral-Small-3.2-24B-Instruct-2506 32 GB 36 GB 12 GB 36 GB
Devstral-Small-2-24B-Instruct-2512 32 GB 36 GB 12 GB 36 GB
gemma-3-27b-it-qat 48 GB 64 GB 40 GB 64 GB
Qwen3-30B-A3B 32 GB 36 GB 12 GB 36 GB
Qwen3-Coder-30B-A3B-Instruct 32 GB 36 GB 12 GB 36 GB
gemma-4-31b-it 48 GB 96 GB 72 GB 96 GB
DeepSeek-R1-Distill-Qwen-32B 36 GB 48 GB 24 GB 48 GB
Qwen3-32B 36 GB 48 GB 24 GB 48 GB
Qwen3.6-35B-A3B 48 GB 48 GB 24 GB 48 GB
Llama-3.3-70B-Instruct 64 GB 96 GB 72 GB 96 GB
Llama-4-Scout-17B-16E-Instruct 96 GB 128 GB 104 GB 128 GB
gpt-oss-120b 96 GB 96 GB 72 GB 96 GB
Qwen3-235B-A22B 192 GB 256 GB 232 GB 256 GB
Qwen3.5-397B-A17B 64 GB measured 64 GB measured 40 GB 64 GB

Context length and data dates

Memory minimums use a 32K context; longer contexts need more memory. Default context is 32768 tokens.

5 fitting models have a M1 Ultra measurement. 11 models have rule-based minimums without our measurements. Figures as of 8 November 2026.

Mac source.

Apple technical specifications (apple.com/mac and the specs page of each Mac, read 2026-11-07; the iMac M6 page says only "up to 170GB/s", so its low end, 153 GB/s, is the 16 GB figure for the same M6 chip on the Mac mini page); table last changed 2026-11-07

Chip ratio source.

llama.cpp's public Apple-silicon benchmark (github.com/ggml-org/llama.cpp/discussions/4167, read 2026-11-07): LLaMA 7B Q4_0 text generation, as a ratio to the M1 Ultra 48-core GPU

Model source.

Dates come from each source text; otherwise table last changed 2026-10-19

Reference test machine.

M1 Ultra, 64 GB, 800 GB/s
Source date and evidence for every model discussed
ModelSource dateEvidence
Qwen3.5-4B 2026-04-29 Measured on M1 Ultra, measured on 2026-04-29; the build details weren't recorded with this figure
Qwen3.5-9B table last changed 2026-10-19 Measured on M1 Ultra, the build and date weren't recorded with this figure
Gemma-4-26B-a4b-it 2026-08-24 Measured on M1 Ultra, from build 1.11.804 on 2026-08-24
Qwen3.6-27B table last changed 2026-10-19 Measured on M1 Ultra, the build and date weren't recorded with this figure
Qwen3.5-397B-A17B 2026-05-01 Measured on M1 Ultra, measured on 2026-05-01; the build details weren't recorded with this figure
Qwen3.8-27B 2026-08-19 Measured on M1 Ultra, from build 1.11.792 on 2026-08-19
Llama-3.3-70B-Instruct 2026-11-08 Rule-based minimum, not measured by us
Qwen2.5-Coder-7B-Instruct 2026-11-08 Rule-based minimum, not measured by us
Qwen3-4B-Instruct-2507 2026-11-08 Rule-based minimum, not measured by us
Devstral-Small-2-24B-Instruct-2512 2026-11-08 Rule-based minimum, not measured by us
Qwen3-0.6B 2026-11-08 Rule-based minimum, not measured by us
gemma-3-4b-it-qat 2026-11-08 Rule-based minimum, not measured by us
Qwen3.6-35B-A3B 2026-11-08 Rule-based minimum, not measured by us
Qwen3.5-0.8B 2026-11-08 Rule-based minimum, not measured by us
Qwen2.5-0.5B-Instruct 2026-11-08 Rule-based minimum, not measured by us
Llama-3.2-1B-Instruct 2026-11-08 Rule-based minimum, not measured by us
Meta-Llama-3.1-8B-Instruct 2026-11-08 Rule-based minimum, not measured by us
Mistral-7B-Instruct-v0.3 2026-11-08 Rule-based minimum, not measured by us
Mistral-Small-3.2-24B-Instruct-2506 2026-11-08 Rule-based minimum, not measured by us
gemma-3-12b-it-qat 2026-11-08 Rule-based minimum, not measured by us
gemma-3-27b-it-qat 2026-11-08 Rule-based minimum, not measured by us
gemma-4-31b-it 2026-11-08 Rule-based minimum, not measured by us
Qwen3-8B 2026-11-08 Rule-based minimum, not measured by us
Qwen3-14B 2026-11-08 Rule-based minimum, not measured by us
Qwen3-32B 2026-11-08 Rule-based minimum, not measured by us
Qwen3-Coder-30B-A3B-Instruct 2026-11-08 Rule-based minimum, not measured by us
Qwen3-30B-A3B 2026-11-08 Rule-based minimum, not measured by us
gpt-oss-20b 2026-11-08 Rule-based minimum, not measured by us
gpt-oss-120b 2026-11-08 Rule-based minimum, not measured by us
DeepSeek-R1-Distill-Qwen-32B 2026-11-08 Rule-based minimum, not measured by us
phi-4 2026-11-08 Rule-based minimum, not measured by us
Llama-4-Scout-17B-16E-Instruct 2026-11-08 Rule-based minimum, not measured by us
Qwen3-235B-A22B 2026-11-08 Rule-based minimum, not measured by us

Outlier Pro: $39 once

Download free Buy Pro

Free to start (Nano and Lite). macOS 15+, Apple silicon. Refund window: 30 days, no questions asked. Priced in US dollars. Checkout shows your currency and any local tax.

Try Outlier on your Mac

Use the memory table and the speed source labels above when choosing a local model.

Download Outlier