New open-weight 🐋 DeepSeek V3. 685B MoE. Beats Claude 3.5 Sonnet on Aider coding benchmark (huggingface.co)

submitted 1 week ago* (last edited 1 week ago) by BB84@mander.xyz to c/localllama@sh.itjust.works

2 comments fedilink hide all child comments

Absolutely humongous model. Mixture of 256 experts with 8 activated each time.

Aider leaderboard: The only model above 🐋 v3 here is ~~Open~~AI o1. DeepSeek is known to make amazing models and Aider rotates their benchmark over time, so it is unlikely that this is a train-on-benchmark situation.

Some more benchmarks: on Reddit.

you are viewing a single comment's thread
view the rest of the comments

[-] xodoh74984@lemmy.world 5 points 1 week ago* (last edited 1 week ago)

For the user whose VRAM knob goes to 11

[-] BB84@mander.xyz 3 points 1 week ago

Someone managed to run it on a cluster of Mac Minis lol https://blog.exolabs.net/day-2/

this post was submitted on 26 Dec 2024

35 points (100.0% liked)

LocalLLaMA

2392 readers

2 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works