Apple Mac Pro (2023) (M2 Ultra)

Configurations

Pick one to see which models it runs. More memory lets larger models fit; bandwidth sets how fast they answer.

Specifications 128 GB configuration

Best LLMs for the Apple Mac Pro (2023) (M2 Ultra) 128 GB

Quality	Model	Quant	Memory	Speed	Runs
A+93Excellent quality (A+) · 93 of 100: how capable the model is at F16, whatever it runs on. Match score 97/100 (quality, fit, speed and memory use) sets the ranking.	Qwen3.6 35B-A3BAlibaba	F16	80.3 GB	51.3 tok/s	Runs great
A+93Excellent quality (A+) · 93 of 100: how capable the model is at F16, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.	OBMiniCPM-V 4.7 35B-A3BOpenBMB	F16	78.9 GB	51.3 tok/s	Runs great
A+93Excellent quality (A+) · 93 of 100: how capable the model is at F16, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.	Qwen3.5 35B-A3BAlibaba	F16	80.3 GB	51.3 tok/s	Runs great
A+92Excellent quality (A+) · 92 of 100: how capable the model is at F16, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.	NANex N2 Mini (35B-A3B)Nex-AGI	F16	78.7 GB	51.3 tok/s	Runs great
A+91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.	Nemotron 3.5 Bolt 74B-A9BNVIDIA	Q6_K	69.8 GB	52.8 tok/s	Runs great
A+92Excellent quality (A+) · 92 of 100: how capable the model is at F16, whatever it runs on. Match score 96/100 (quality, fit, speed and memory use) sets the ranking.	Gemma 4 26B-A4BGoogle	F16	60.3 GB	42.5 tok/s	Runs great
A+91Excellent quality (A+) · 91 of 100: how capable the model is at F16, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.	KKAT-Coder V2.5 Dev (35B-A3B)Kuaishou	F16	77.8 GB	51.3 tok/s	Runs great
A+91Excellent quality (A+) · 91 of 100: how capable the model is at F16, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.	ISSage-A1.5 35B-A3BInternScience	F16	80.3 GB	51.3 tok/s	Runs great
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.	AAKolibri 1 (78B-A3.5B)Aleph Alpha	Q6_K	72.5 GB	105 tok/s	Runs great
A+90Excellent quality (A+) · 90 of 100: how capable the model is at F16, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking.	DROrnith 1.5 35B-A3BDeepReinforce	F16	80.3 GB	51.3 tok/s	Runs great

Best Image models for the Apple Mac Pro (2023) (M2 Ultra) 128 GB

Quality	Model	Quant	Memory	Speed	Runs
A+91Excellent quality (A+) · 91 of 100: how capable the model is at FP8, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking.	MMMiniMax H3 ImageMiniMax	FP8	72.0 GB	39 s	Runs well
A84Great quality (A) · 84 of 100: how capable the model is at FP16, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.	BFFLUX.2 [klein] 9BBlack Forest Labs	FP16	37.1 GB	7.9 s	Runs great
A+92Excellent quality (A+) · 92 of 100: how capable the model is at FP16, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.	KKrea 2 TurboKrea	FP16	37.4 GB	19 s	Runs well
A+92Excellent quality (A+) · 92 of 100: how capable the model is at FP16, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.	IIdeogram 4Ideogram	FP16	57.3 GB	1.8 min	Slow
A+90Excellent quality (A+) · 90 of 100: how capable the model is at FP8, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.	Cosmos3-Super Text2Image (64B)NVIDIA	FP8	69.1 GB	2.6 min	Very slow
A+86Excellent quality (A+) · 86 of 100: how capable the model is at FP16, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking.	AGMing-Image 0.1 DesignAnt Group (inclusionAI)	FP16	63.9 GB	71 s	Slow

Best Video models for the Apple Mac Pro (2023) (M2 Ultra) 128 GB

Quality	Model	Quant	Memory	Speed	Runs
A+86Excellent quality (A+) · 86 of 100: how capable the model is at FP8, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking.	LLTX-2.5 (22B, video + audio)Lightricks	FP8	48.3 GB	6.0 min	Runs well
A+86Excellent quality (A+) · 86 of 100: how capable the model is at FP16, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking.	LLTX-2.3Lightricks	FP16	75.4 GB	29.1 min	Slow
A+89Excellent quality (A+) · 89 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking.	MMMiniMax H3 (33B, video + audio)MiniMax	Q8 GGUF	68.2 GB	87.1 min	Very slow
A82Great quality (A) · 82 of 100: how capable the model is at FP16, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking.	LLTX-2 (19B, video + audio)Lightricks	FP16	75.4 GB	29.1 min	Slow
A+86Excellent quality (A+) · 86 of 100: how capable the model is at FP16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking.	Wan 2.2 I2V A14BAlibaba	FP16	58.0 GB	1.9 h	Very slow

Best Decision models for the Apple Mac Pro (2023) (M2 Ultra) 128 GB

Quality	Model	Quant	Memory	Speed	Runs
A+86Excellent quality (A+) · 86 of 100: how capable the model is at F16, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.	JAJina Reranker v3.5Jina AI	F16	9.7 GB	25 ms	Runs great
A+90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking.	Qwen3 Reranker 4BAlibaba	Q8_0	12.8 GB	135 ms	Runs well
A84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.	SAIntern-Decision 4BShanghai AI Lab	F16	17.4 GB	96 ms	Runs great
A84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.	JAJina Reranker v3Jina AI	F16	9.7 GB	25 ms	Runs great
A+88Excellent quality (A+) · 88 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking.	ZEzerank-2ZeroEntropy	Q8_0	12.8 GB	135 ms	Runs well
A82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking.	LAd1 3BLiquid AI	F16	14.6 GB	67 ms	Runs great
A82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking.	Mmxbai-rerank-large v2Mixedbread	F16	11.4 GB	59 ms	Runs great
A+86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking.	Shieldstral 1.0 3BMistral AI	Q8_0	12.6 GB	130 ms	Runs great

Other products with the Apple M2 Ultra (128 GB)

• Mac Studio (2023) (M2 Max or M2 Ultra)Apple · Desktop · 32, 64, 96, 128 or 192 GB · $1,999–$3,999Product page (opens in a new tab)