Raw, sourced benchmark data with full methodology — tok/s, memory, accuracy — plus downloadable CC-BY datasets you can cite.
The measured reverse-engineering: ~45% on SWE-bench Verified (18/40 blind), mid-50s to low-60s with local engineering, and a genuine 15–20-point wall. Where it passed tests, the 3 hard walls, and the biggest lever.
DatasetTok/s and memory data for local AI on Apple Silicon in 2026: Outlier measured, Ollama and LM Studio from public benchmarks.
DatasetA reference table mapping Mac unified RAM to which local AI models fit, their disk sizes, and measured tokens/sec on an M1 Ultra. Plan your build or buy.
DatasetRaw side-by-side data: 54 prompts answered by Outlier Core 27B and Claude Opus 4.7, scored against a rubric we wrote ourselves. Compare the results yourself.
DatasetMMLU for every shipping tier, measured through the shipped 1.11.804 build on an M1 Ultra: Nano 52.0%, Lite 77.0%, Quick 81.0%, Core 89.5%, Vision 3.8 82.5%. n=200, with the superseded 1.11.757 run kept for comparison.
DatasetHow long a new chat waits for its first word, before and after the system prompt's work is saved and reused. Core and Vision 3.8: about 20 s to about 1 s, with the same words. Raw tables from an M1 Ultra.
DatasetOutlier Lite and Nano on 20 short word problems: Lite 12 right answering straight away and 20 after working each one out first, Nano 10 and then 60 of 60 over three runs. The cost is 6 to 8 s instead of 0.4 s. Raw tables from an M1 Ultra.
DatasetOutlier Nano, Lite and Core gave the identical reply 3 of 3 times on every test at temperature 0.7. The cause, the fix, and a 2-minute test for your own app. Tables from an M1 Ultra.
DatasetRaw tok/s and memory data for Outlier's MoE engines on Plus 397B and Vision 35B. Why both streaming engines (V10, V11) were retired in favor of V9…
Free: Nano + Lite. Pro: $249 once · or 4 × $62.25; $124.50 for the first 25 · or 4 × $31.13. macOS 26+. In the US, Klarna or Afterpay at checkout: four payments, two weeks apart. Refund window: 30 days, no questions asked.
Download free (290 MB) Buy ProOpen weights ship constantly and most are not worth your disk. When one beats a tier Outlier already has, on hardware you already own, we say so and what it replaces. That is the only reason we email.
Your address and which of our sites you sent it from. No IP, no user agent, no referer. Nothing is sent until you press the button. Privacy.