24
submitted 1 day ago by SurpriZe@lemm.ee to c/asklemmy@lemmy.ml

Curious about what model is best to use on my RTX 3080 + Ryzen 5 3600 since I've just found out about this.

top 6 comments
sorted by: hot top controversial new old
[-] geneva_convenience@lemmy.ml 2 points 10 hours ago

Llama3.1 8b,the other versions are too big to run on gpu

[-] yogthos@lemmy.ml 1 points 11 hours ago
[-] simple@lemm.ee 11 points 1 day ago

The Llama 3.1 models are probably the best all-rounders, with the Llama 3.1 8B version being the most popular.

[-] PerogiBoi@lemmy.ca 2 points 1 day ago

Moistral.

It has no qualms throwing ethics and legality to the wind :)

[-] SurpriZe@lemm.ee 1 points 22 hours ago* (last edited 22 hours ago)

What do you mean by that? Do you not recommend it?

[-] PerogiBoi@lemmy.ca 0 points 13 hours ago

Moistral is the name of the model. I do recommend it

this post was submitted on 20 Oct 2024
24 points (81.6% liked)

Asklemmy

43645 readers
1072 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago
MODERATORS