Weekly archive

New local AI models, Jan 29 – Feb 4, 2024

2 open models released Jan 29 – Feb 4, 2024, with how each runs on five reference devices.

  1. Qwen1.5 14B Chat

    Alibaba · LLM · 14B ·

    33Basic quality (D) · 33 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  2. Qwen1.5 7B Chat

    Alibaba · LLM · 7.7B ·

    26Basic quality (D) · 26 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 54/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?