Weekly archive

New local AI models, Feb 17–23, 2025

6 open models released Feb 17–23, 2025, with how each runs on five reference devices.

  1. Granite 3.2 8B Instruct

    IBM · LLM · 8.2B ·

    46Fair quality (C) · 46 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  2. Moonlight 16B-A3B Instruct

    Moonshot AI · LLM · 16B (3.0B active) ·

    46Fair quality (C) · 46 of 100: how capable the model is at F16, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  3. Gemma 3 4B IT

    Google · LLM · 4.3B ·

    45Fair quality (C) · 45 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  4. Phi-4 Mini (3.8B)

    Microsoft · LLM · 3.8B ·

    44Fair quality (C) · 44 of 100: how capable the model is at F16, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  5. Granite 3.2 2B Instruct

    IBM · LLM · 2.5B ·

    30Basic quality (D) · 30 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  6. Granite Vision 3.2 2B

    IBM · LLM · 3.0B ·

    26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 53/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?