Weekly archive

New local AI models, Oct 30 – Nov 5, 2023

1 open model released Oct 30 – Nov 5, 2023, with how each runs on five reference devices.

DeepSeek Coder 33B Instruct

DeepSeek · LLM · 33B · released Nov 1

41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking.

Runs on
- Phone iPhone 17 Pro Won't runover the app memory limit
- Laptop MacBook Pro M5 Pro 64 GB Runs well 12.6 tok/s
- Gaming PC RTX 5090 32 GB Runs great 66.0 tok/s
- Edge board Jetson Orin NX 16 GB Won't run
- Workstation Mac Studio 512 GB Runs well 26.0 tok/s
Memory, every quant and how to run it Check your own device

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

DeepSeek Coder 33B Instruct