Apple MacBook Pro 16-inch (2024, M4 Pro): which AI models can it run?

Estimated from the specifications below. Choose the memory size you have or plan to buy, then read the table for that size.

Specifications

Brand

Apple

Year

2024

Chip

Apple M4 Pro

Processor

14-core CPU

Graphics

20-core GPU

Memory type

unified memory

Memory options

24 GB, 48 GB

Memory bandwidth

273 GB/s

Sources: https://support.apple.com/en-us/121554

Apple lists 273GB/s for M4 Pro and 24GB base memory, configurable to 48GB for M4 Pro. The same page lists M4 Max options with more memory.

With 24 GB of memory

About 16.8 GB of it can hold a model.

Models marked "thinks first" can write out their reasoning before they answer, so a job takes longer than the speed alone suggests.

With 48 GB of memory

About 33.6 GB of it can hold a model.

Models marked "thinks first" can write out their reasoning before they answer, so a job takes longer than the speed alone suggests.

Reported by others

Other people ran the standard llama-bench test on this chip and published the results. They are not Findra scores. The test uses a small 7-billion-parameter model, so larger models will be slower than these figures. All published benchmarks.

Reported by others, not tested by us. Results come from a public community thread; builds and settings differ between submitters.

Published chip scores

Blender Open Data publishes the median render score of its Cycles test for each chip, and PassMark publishes average CPU and 3D scores, both from results people submitted. Higher is faster. These are not Findra scores. Scores from different tests, and from different Blender versions, are not comparable with each other.

Editing, gaming, CAD and other work

Each app below publishes a minimum and a recommended system requirement. We compare them with this laptop's memory and graphics memory. We do not judge the graphics chip's class, the processor generation or the operating system, because the makers describe those in words: check the source link for the exact card, processor and system they name. Many apps and games run only on Windows or only on macOS. Integrated graphics count as below any requirement for a dedicated card. Not known means the maker does not state this laptop's graphics memory.

Labels follow the makers' published lists. All use cases.

Speed is the speed of writing an answer, shown as a range. Reading speed is not estimated. How the estimates work · How close they are · Back to the finder