What AI models can a Mac with 24 GB run?
- A Mac with 24 GB fits 19 models for short chats, 16 for long 32,000-token work, from 33 models in our list. We use measured minimums where available and our cautious rule for the rest.
- For long work, the roomiest fit is Qwen3.5-4B. It has the lowest listed memory floor, 6 GB, leaving 18 GB above that floor.
- For long work, the smallest fit by parameter count is Qwen2.5-0.5B-Instruct, listed as 0.5B dense. It takes 0.28 GB on disk. The largest fit by parameter count is Qwen3.8-27B, listed as 27B dense.
Every model that fits
The short-chat column can open up choices that need more memory for long work. All balances and larger-Mac suggestions here follow the long-work column. Where we have a measurement, that result fills both columns.
At this capacity, check the newly admitted models before assuming the whole fit list has changed. The transition paragraph names the additions from the previous memory size. Models already admitted keep their listed floors and gain room above them. That extra room is visible in the memory-left column, so you can compare an existing small model with a new candidate on the same basis.
The representative speed columns sample different points in this fit list. Find the Mac name first, then follow the model heading across. A measured reference can support estimates for other chips. Each cell keeps the calculator wording available so the evidence stays attached to the rate. A range needs that source when comparing machines with different memory bandwidth.
For a download decision, put the storage requirement beside the available disk space on your Mac. For a running decision, use the source memory minimum and the context warning. These checks answer separate practical questions. The table of excluded models shows how far each candidate sits above this tier and where a larger listed configuration would admit it. Use those individual targets to plan a change in hardware.
Compared with the 16 GB memory page, this size adds 6 models. The added models are Mistral-7B-Instruct-v0.3, Meta-Llama-3.1-8B-Instruct, Qwen3-8B, gpt-oss-20b, Qwen3.6-27B, Qwen3.8-27B. Models already below the earlier limit gain more space above their minimum. The chip changes the speed shown below, while the fit list follows the same memory test.
| Model | Fit | Short chats | Long 32,000-token work | Memory left for long work | Disk |
|---|---|---|---|---|---|
| Qwen2.5-0.5B-Instruct | fits | 8 GB | 8 GB | 16 GB | 0.28 GB |
| Qwen3-0.6B | fits | 8 GB | 16 GB | 8 GB | 0.34 GB |
| Qwen3.5-0.8B | fits | 8 GB | 8 GB | 16 GB | 0.63 GB |
| Llama-3.2-1B-Instruct | fits | 8 GB | 8 GB | 16 GB | 0.7 GB |
| Qwen3-4B-Instruct-2507 | fits | 16 GB | 16 GB | 8 GB | 2.26 GB |
| Qwen3.5-4B | fits | 6 GB measured | 6 GB measured | 18 GB | 2.37 GB |
| gemma-3-4b-it-qat | fits | 16 GB | 16 GB | 8 GB | 3 GB |
| Mistral-7B-Instruct-v0.3 | fits | 16 GB | 18 GB | 6 GB | 4.08 GB |
| Qwen2.5-Coder-7B-Instruct | fits | 16 GB | 16 GB | 8 GB | 4.28 GB |
| Meta-Llama-3.1-8B-Instruct | fits | 16 GB | 18 GB | 6 GB | 4.52 GB |
| Qwen3-8B | tight | 16 GB | 24 GB | 0 GB | 4.61 GB |
| Qwen3.5-9B | fits | 12 GB measured | 12 GB measured | 12 GB | 5.04 GB |
| gpt-oss-20b | tight | 24 GB | 24 GB | 0 GB | 11.18 GB |
| Gemma-4-26B-a4b-it | fits | 16 GB measured | 16 GB measured | 8 GB | 15.61 GB |
| Qwen3.6-27B | tight | 24 GB measured | 24 GB measured | 0 GB | 15.13 GB |
| Qwen3.8-27B | tight | 24 GB measured | 24 GB measured | 0 GB | 15.5 GB |
Speed table by chip
The table covers all 20 Mac models sold with 24 GB in our Mac list, including older models. Each row names the exact Mac and chip. The representative models are Qwen3.5-4B, Qwen2.5-0.5B-Instruct, Qwen3.8-27B, Qwen2.5-Coder-7B-Instruct. They cover the roomiest fit, the smallest model, the largest model and the middle of this fit list, with repeated names removed.
| Mac and chip | Qwen3.5-4B | Qwen2.5-0.5B-Instruct | Qwen3.8-27B | Qwen2.5-Coder-7B-Instruct |
|---|---|---|---|---|
| MacBook Air M2Apple M2 |
about 7.2 to 21 tokens/s
estimate, not measured by us
How we estimate speed7.17 to 20.94 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 71 to 143 tokens/s
estimate, not measured by us
How we estimate speed71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
about 1.7 to 5.0 tokens/s
estimate, not measured by us
How we estimate speed1.72 to 5.03 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 4.7 to 9.3 tokens/s
estimate, not measured by us
How we estimate speed4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
| MacBook Pro 13 M2Apple M2 |
about 7.2 to 21 tokens/s
estimate, not measured by us
How we estimate speed7.17 to 20.94 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 71 to 143 tokens/s
estimate, not measured by us
How we estimate speed71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
about 1.7 to 5.0 tokens/s
estimate, not measured by us
How we estimate speed1.72 to 5.03 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 4.7 to 9.3 tokens/s
estimate, not measured by us
How we estimate speed4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
| Mac mini M2Apple M2 |
about 7.2 to 21 tokens/s
estimate, not measured by us
How we estimate speed7.17 to 20.94 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 71 to 143 tokens/s
estimate, not measured by us
How we estimate speed71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
about 1.7 to 5.0 tokens/s
estimate, not measured by us
How we estimate speed1.72 to 5.03 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 4.7 to 9.3 tokens/s
estimate, not measured by us
How we estimate speed4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
| MacBook Air 13 M3Apple M3 |
about 7.2 to 20 tokens/s
estimate, not measured by us
How we estimate speed7.17 to 20.44 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 71 to 143 tokens/s
estimate, not measured by us
How we estimate speed71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
about 1.7 to 4.9 tokens/s
estimate, not measured by us
How we estimate speed1.72 to 4.91 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 4.7 to 9.3 tokens/s
estimate, not measured by us
How we estimate speed4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
| MacBook Air 15 M3Apple M3 |
about 7.2 to 20 tokens/s
estimate, not measured by us
How we estimate speed7.17 to 20.44 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 71 to 143 tokens/s
estimate, not measured by us
How we estimate speed71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
about 1.7 to 4.9 tokens/s
estimate, not measured by us
How we estimate speed1.72 to 4.91 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 4.7 to 9.3 tokens/s
estimate, not measured by us
How we estimate speed4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
| iMac M3Apple M3 |
about 7.2 to 20 tokens/s
estimate, not measured by us
How we estimate speed7.17 to 20.44 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 71 to 143 tokens/s
estimate, not measured by us
How we estimate speed71.42 to 142.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
about 1.7 to 4.9 tokens/s
estimate, not measured by us
How we estimate speed1.72 to 4.91 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 100 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 4.7 to 9.3 tokens/s
estimate, not measured by us
How we estimate speed4.67 to 9.35 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 100 GB/s divided by active weights in GB |
| MacBook Pro 14 M4Apple M4 |
about 8.6 to 23 tokens/s
estimate, not measured by us
How we estimate speed8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 86 to 171 tokens/s
estimate, not measured by us
How we estimate speed85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
about 2.1 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 5.6 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
| iMac M4Apple M4 |
about 8.6 to 23 tokens/s
estimate, not measured by us
How we estimate speed8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 86 to 171 tokens/s
estimate, not measured by us
How we estimate speed85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
about 2.1 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 5.6 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
| Mac mini M4Apple M4 |
about 8.6 to 23 tokens/s
estimate, not measured by us
How we estimate speed8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 86 to 171 tokens/s
estimate, not measured by us
How we estimate speed85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
about 2.1 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 5.6 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
| Mac mini M4 ProApple M4 Pro |
about 20 to 49 tokens/s
estimate, not measured by us
How we estimate speed19.57 to 48.55 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 195 to 390 tokens/s
estimate, not measured by us
How we estimate speed195 to 390 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB |
about 4.7 to 12 tokens/s
estimate, not measured by us
How we estimate speed4.69 to 11.65 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 13 to 26 tokens/s
estimate, not measured by us
How we estimate speed12.75 to 25.52 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB |
| MacBook Pro M4 ProApple M4 Pro |
about 20 to 49 tokens/s
estimate, not measured by us
How we estimate speed19.57 to 48.55 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 195 to 390 tokens/s
estimate, not measured by us
How we estimate speed195 to 390 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB |
about 4.7 to 12 tokens/s
estimate, not measured by us
How we estimate speed4.69 to 11.65 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 273 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 13 to 26 tokens/s
estimate, not measured by us
How we estimate speed12.75 to 25.52 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 273 GB/s divided by active weights in GB |
| MacBook Air 13 M4Apple M4 |
about 8.6 to 23 tokens/s
estimate, not measured by us
How we estimate speed8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 86 to 171 tokens/s
estimate, not measured by us
How we estimate speed85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
about 2.1 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 5.6 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
| MacBook Air 15 M4Apple M4 |
about 8.6 to 23 tokens/s
estimate, not measured by us
How we estimate speed8.6 to 23.09 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 86 to 171 tokens/s
estimate, not measured by us
How we estimate speed85.71 to 171.43 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
about 2.1 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.06 to 5.54 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 120 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 5.6 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.6 to 11.22 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 120 GB/s divided by active weights in GB |
| MacBook Air 13 M5Apple M5 |
about 11 to 23 tokens/s
estimate, not measured by us
How we estimate speed10.97 to 22.95 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 109 to 219 tokens/s
estimate, not measured by us
How we estimate speed109.28 to 218.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB |
about 2.6 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.63 to 5.51 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 7.1 to 14 tokens/s
estimate, not measured by us
How we estimate speed7.14 to 14.3 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB |
| MacBook Air 15 M5Apple M5 |
about 11 to 23 tokens/s
estimate, not measured by us
How we estimate speed10.97 to 22.95 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 109 to 219 tokens/s
estimate, not measured by us
How we estimate speed109.28 to 218.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB |
about 2.6 to 5.5 tokens/s
estimate, not measured by us
How we estimate speed2.63 to 5.51 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 7.1 to 14 tokens/s
estimate, not measured by us
How we estimate speed7.14 to 14.3 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153 GB/s divided by active weights in GB |
| MacBook Pro 14 M6Apple M6 |
about 11 to 26 tokens/s
estimate, not measured by us
How we estimate speed10.97 to 25.75 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 109 to 243 tokens/s
estimate, not measured by us
How we estimate speed109.28 to 242.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB |
about 2.6 to 6.2 tokens/s
estimate, not measured by us
How we estimate speed2.63 to 6.18 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 7.1 to 16 tokens/s
estimate, not measured by us
How we estimate speed7.14 to 15.89 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB |
| MacBook Pro M5 ProApple M5 Pro |
about 22 to 48 tokens/s
estimate, not measured by us
How we estimate speed22.01 to 47.76 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 219 to 439 tokens/s
estimate, not measured by us
How we estimate speed219.28 to 438.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB |
about 5.3 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.28 to 11.46 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 14 to 29 tokens/s
estimate, not measured by us
How we estimate speed14.34 to 28.7 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB |
| Mac mini M6Apple M6 |
about 11 to 26 tokens/s
estimate, not measured by us
How we estimate speed10.97 to 25.75 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 109 to 243 tokens/s
estimate, not measured by us
How we estimate speed109.28 to 242.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB |
about 2.6 to 6.2 tokens/s
estimate, not measured by us
How we estimate speed2.63 to 6.18 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 7.1 to 16 tokens/s
estimate, not measured by us
How we estimate speed7.14 to 15.89 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB |
| Mac mini M5 ProApple M5 Pro |
about 22 to 48 tokens/s
estimate, not measured by us
How we estimate speed22.01 to 47.76 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 219 to 439 tokens/s
estimate, not measured by us
How we estimate speed219.28 to 438.58 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB |
about 5.3 to 11 tokens/s
estimate, not measured by us
How we estimate speed5.28 to 11.46 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 307 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 14 to 29 tokens/s
estimate, not measured by us
How we estimate speed14.34 to 28.7 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 307 GB/s divided by active weights in GB |
| iMac M6Apple M6 |
about 11 to 26 tokens/s
estimate, not measured by us
How we estimate speed10.97 to 25.75 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 71.7 tokens/s at 800 GB/s |
about 109 to 243 tokens/s
estimate, not measured by us
How we estimate speed109.28 to 242.86 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB |
about 2.6 to 6.2 tokens/s
estimate, not measured by us
How we estimate speed2.63 to 6.18 tokens/s; estimate: low end from memory bandwidth (Mac bandwidth 153-170 GB/s against 800 GB/s), high end from this chip's speed in llama.cpp's public Apple-silicon benchmark; measured on an M1 Ultra 64 GB: 17.2 tokens/s at 800 GB/s |
about 7.1 to 16 tokens/s
estimate, not measured by us
How we estimate speed7.14 to 15.89 tokens/s; estimate, not measured by us; 0.20 to 0.40 x Mac bandwidth 153-170 GB/s divided by active weights in GB |
What does not fit, and the next memory size
17 models exceed 24 GB for long work.
The next listed memory size is 32 GB. It admits 2 more models from this table. Those models are phi-4, Qwen3-14B. The last column below gives the next suitable size for each excluded model, including sizes outside these memory guides.
| Model | Short chats | Long 32,000-token work | Memory short for long work | Next listed memory |
|---|---|---|---|---|
| gemma-3-12b-it-qat | 24 GB | 48 GB | 24 GB | 48 GB |
| phi-4 | 24 GB | 32 GB | 8 GB | 32 GB |
| Qwen3-14B | 24 GB | 32 GB | 8 GB | 32 GB |
| Mistral-Small-3.2-24B-Instruct-2506 | 32 GB | 36 GB | 12 GB | 36 GB |
| Devstral-Small-2-24B-Instruct-2512 | 32 GB | 36 GB | 12 GB | 36 GB |
| gemma-3-27b-it-qat | 48 GB | 64 GB | 40 GB | 64 GB |
| Qwen3-30B-A3B | 32 GB | 36 GB | 12 GB | 36 GB |
| Qwen3-Coder-30B-A3B-Instruct | 32 GB | 36 GB | 12 GB | 36 GB |
| gemma-4-31b-it | 48 GB | 96 GB | 72 GB | 96 GB |
| DeepSeek-R1-Distill-Qwen-32B | 36 GB | 48 GB | 24 GB | 48 GB |
| Qwen3-32B | 36 GB | 48 GB | 24 GB | 48 GB |
| Qwen3.6-35B-A3B | 48 GB | 48 GB | 24 GB | 48 GB |
| Llama-3.3-70B-Instruct | 64 GB | 96 GB | 72 GB | 96 GB |
| Llama-4-Scout-17B-16E-Instruct | 96 GB | 128 GB | 104 GB | 128 GB |
| gpt-oss-120b | 96 GB | 96 GB | 72 GB | 96 GB |
| Qwen3-235B-A22B | 192 GB | 256 GB | 232 GB | 256 GB |
| Qwen3.5-397B-A17B | 64 GB measured | 64 GB measured | 40 GB | 64 GB |
Context length and data dates
Memory minimums use a 32K context; longer contexts need more memory. Default context is 32768 tokens.
5 fitting models have a M1 Ultra measurement. 11 models have rule-based minimums without our measurements. Figures as of 8 November 2026.
Mac source.
Apple technical specifications (apple.com/mac and the specs page of each Mac, read 2026-11-07; the iMac M6 page says only "up to 170GB/s", so its low end, 153 GB/s, is the 16 GB figure for the same M6 chip on the Mac mini page); table last changed 2026-11-07Chip ratio source.
llama.cpp's public Apple-silicon benchmark (github.com/ggml-org/llama.cpp/discussions/4167, read 2026-11-07): LLaMA 7B Q4_0 text generation, as a ratio to the M1 Ultra 48-core GPUModel source.
Dates come from each source text; otherwise table last changed 2026-10-19Reference test machine.
M1 Ultra, 64 GB, 800 GB/s| Model | Source date | Evidence |
|---|---|---|
| Qwen3.5-4B | 2026-04-29 | Measured on M1 Ultra, measured on 2026-04-29; the build details weren't recorded with this figure |
| Qwen3.5-9B | table last changed 2026-10-19 | Measured on M1 Ultra, the build and date weren't recorded with this figure |
| Gemma-4-26B-a4b-it | 2026-08-24 | Measured on M1 Ultra, from build 1.11.804 on 2026-08-24 |
| Qwen3.6-27B | table last changed 2026-10-19 | Measured on M1 Ultra, the build and date weren't recorded with this figure |
| Qwen3.5-397B-A17B | 2026-05-01 | Measured on M1 Ultra, measured on 2026-05-01; the build details weren't recorded with this figure |
| Qwen3.8-27B | 2026-08-19 | Measured on M1 Ultra, from build 1.11.792 on 2026-08-19 |
| Llama-3.3-70B-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen2.5-Coder-7B-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-4B-Instruct-2507 | 2026-11-08 | Rule-based minimum, not measured by us |
| Devstral-Small-2-24B-Instruct-2512 | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-0.6B | 2026-11-08 | Rule-based minimum, not measured by us |
| gemma-3-4b-it-qat | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3.6-35B-A3B | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3.5-0.8B | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen2.5-0.5B-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Llama-3.2-1B-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Meta-Llama-3.1-8B-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Mistral-7B-Instruct-v0.3 | 2026-11-08 | Rule-based minimum, not measured by us |
| Mistral-Small-3.2-24B-Instruct-2506 | 2026-11-08 | Rule-based minimum, not measured by us |
| gemma-3-12b-it-qat | 2026-11-08 | Rule-based minimum, not measured by us |
| gemma-3-27b-it-qat | 2026-11-08 | Rule-based minimum, not measured by us |
| gemma-4-31b-it | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-8B | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-14B | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-32B | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-Coder-30B-A3B-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-30B-A3B | 2026-11-08 | Rule-based minimum, not measured by us |
| gpt-oss-20b | 2026-11-08 | Rule-based minimum, not measured by us |
| gpt-oss-120b | 2026-11-08 | Rule-based minimum, not measured by us |
| DeepSeek-R1-Distill-Qwen-32B | 2026-11-08 | Rule-based minimum, not measured by us |
| phi-4 | 2026-11-08 | Rule-based minimum, not measured by us |
| Llama-4-Scout-17B-16E-Instruct | 2026-11-08 | Rule-based minimum, not measured by us |
| Qwen3-235B-A22B | 2026-11-08 | Rule-based minimum, not measured by us |
Outlier Pro: $39 once · Black Friday sale: $16.99 once through December 2. Then $39.
Free to start (Nano and Lite). macOS 15+, Apple silicon. Refund window: 30 days, no questions asked. Priced in US dollars. Checkout shows your currency and any local tax.
Try Outlier on your Mac
Use the memory table and the speed source labels above when choosing a local model.
Download Outlier