submitted 2 months ago by SurpriZe@lemm.ee to c/asklemmy@lemmy.ml

6 comments fedilink hide all child comments

Curious about what model is best to use on my RTX 3080 + Ryzen 5 3600 since I've just found out about this.

you are viewing a single comment's thread
view the rest of the comments

[-] geneva_convenience@lemmy.ml 3 points 2 months ago

Llama3.1 8b,the other versions are too big to run on gpu

this post was submitted on 20 Oct 2024

25 points (80.5% liked)

Asklemmy

44276 readers

769 users here now

A loosely moderated place to ask open-ended questions

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago

MODERATORS