Weekly archive

New local AI models, Jan 8–14, 2024

3 open models released Jan 8–14, 2024, with how each runs on five reference devices.

  1. Nous Hermes 2 Mixtral 8x7B DPO

    Nous Research · LLM · 47B (12.9B active) ·

    51Fair quality (C) · 51 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  2. InternLM2 Chat 20B

    Shanghai AI Lab · LLM · 20B ·

    39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

  3. DeepSeek MoE 16B Chat

    DeepSeek · LLM · 16B (2.8B active) ·

    26Basic quality (D) · 26 of 100: how capable the model is at F16, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking.

    Runs on

    Memory, every quant and how to run it Check your own device

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?