Apple MacBook Pro 16-inch (Nov 2023, M3 Max 14-core CPU, 30-core GPU): which AI models can it run?
Estimated from the specifications below. Choose the memory size you have or plan to buy, then read the table for that size.
Specifications
- Brand
- Apple
- Year
- 2023
- Chip
- Apple M3 Max
- Processor
- 14-core CPU (10 performance, 4 efficiency)
- Graphics
- 30-core GPU
- Memory type
- unified memory
- Memory options
- 36 GB, 96 GB
- Memory bandwidth
- 300 GB/s
Sources: https://support.apple.com/en-us/117737
Apple lists 300GB/s for this variant.
With 36 GB of memory
About 25.2 GB of it can hold a model.
| Model | Fit | Needs (GB) | Writing speed (tokens per second) | Speed | Quality | Basis |
|---|---|---|---|---|---|---|
| Llama 3.2 3B llama3.2:3b |
Fits | 5 | 52 to 98 | Fast | not measured yet | Estimated |
| Qwen3 4B qwen3:4b · thinks first |
Fits | 6 | 42 to 78 | Fast | not measured yet | Estimated |
| Gemma 3 4B gemma3:4b |
Fits | 6.7 | 32 to 59 | Fast | not measured yet | Estimated |
| Mistral 7B v0.3 mistral:7b |
Fits | 7.8 | 24 to 44 | Fast | not measured yet | Estimated |
| Llama 3.1 8B llama3.1:8b |
Fits | 8.3 | 21 to 40 | Fast | not measured yet | Estimated |
| Qwen3 8B qwen3:8b · thinks first |
Fits | 8.9 | 20 to 38 | Fast | not measured yet | Estimated |
| Gemma 3 12B gemma3:12b |
Fits | 15.9 | 13 to 24 | Fast | not measured yet | Estimated |
| DeepSeek-R1 Distill Qwen 14B deepseek-r1:14b · thinks first |
Fits | 13.7 | 12 to 22 | Fast | not measured yet | Estimated |
| Phi-4 14B phi4:14b |
Fits | 13.9 | 12 to 21 | Fast | not measured yet | Estimated |
| Qwen3 14B qwen3:14b · thinks first |
Fits | 13.4 | 11 to 21 | Fast | not measured yet | Estimated |
| gpt-oss 20B gpt-oss:20b · thinks first |
Fits | 16.5 | 26 to 49 | Fast | not measured yet | Estimated |
| Gemma 3 27B gemma3:27b |
Won't fit | 27.2 | not known | n/a | not measured yet | Estimated |
| Qwen3 30B (A3B) qwen3:30b · thinks first |
Fits | 22.6 | 31 to 57 | Fast | 9.3/10 | Estimated |
| Qwen3 32B qwen3:32b |
Won't fit | 26.3 | not known | n/a | not measured yet | Estimated |
| Llama 3.1 70B llama3.1:70b |
Won't fit | 51.5 | not known | n/a | not measured yet | Estimated |
| gpt-oss 120B gpt-oss:120b |
Won't fit | 70.5 | not known | n/a | not measured yet | Estimated |
Models marked "thinks first" can write out their reasoning before they answer, so a job takes longer than the speed alone suggests.
With 96 GB of memory
About 67.2 GB of it can hold a model.
| Model | Fit | Needs (GB) | Writing speed (tokens per second) | Speed | Quality | Basis |
|---|---|---|---|---|---|---|
| Llama 3.2 3B llama3.2:3b |
Fits | 5 | 52 to 98 | Fast | not measured yet | Estimated |
| Qwen3 4B qwen3:4b · thinks first |
Fits | 6 | 42 to 78 | Fast | not measured yet | Estimated |
| Gemma 3 4B gemma3:4b |
Fits | 6.7 | 32 to 59 | Fast | not measured yet | Estimated |
| Mistral 7B v0.3 mistral:7b |
Fits | 7.8 | 24 to 44 | Fast | not measured yet | Estimated |
| Llama 3.1 8B llama3.1:8b |
Fits | 8.3 | 21 to 40 | Fast | not measured yet | Estimated |
| Qwen3 8B qwen3:8b · thinks first |
Fits | 8.9 | 20 to 38 | Fast | not measured yet | Estimated |
| Gemma 3 12B gemma3:12b |
Fits | 15.9 | 13 to 24 | Fast | not measured yet | Estimated |
| DeepSeek-R1 Distill Qwen 14B deepseek-r1:14b · thinks first |
Fits | 13.7 | 12 to 22 | Fast | not measured yet | Estimated |
| Phi-4 14B phi4:14b |
Fits | 13.9 | 12 to 21 | Fast | not measured yet | Estimated |
| Qwen3 14B qwen3:14b · thinks first |
Fits | 13.4 | 11 to 21 | Fast | not measured yet | Estimated |
| gpt-oss 20B gpt-oss:20b · thinks first |
Fits | 16.5 | 26 to 49 | Fast | not measured yet | Estimated |
| Gemma 3 27B gemma3:27b |
Fits | 27.2 | 6.2 to 11 | Unclear could be Moderate or Fast | not measured yet | Estimated |
| Qwen3 30B (A3B) qwen3:30b · thinks first |
Fits | 22.6 | 31 to 57 | Fast | 9.3/10 | Estimated |
| Qwen3 32B qwen3:32b · thinks first |
Fits | 26.3 | 5.2 to 9.8 | Moderate | not measured yet | Estimated |
| Llama 3.1 70B llama3.1:70b |
Fits | 51.5 | 2.4 to 4.5 | Slow | not measured yet | Estimated |
| gpt-oss 120B gpt-oss:120b |
Won't fit | 70.5 | not known | n/a | not measured yet | Estimated |
Models marked "thinks first" can write out their reasoning before they answer, so a job takes longer than the speed alone suggests.
Speed is the speed of writing an answer, shown as a range. Reading speed is not estimated. How the estimates work · How close they are · Back to the finder