1205
What is this? (Its OC!)
(lemmy.world)
I use Arch btw
Sister communities:
Community rules
Please report posts and comments that break these rules!
tinyllama 1.1b would probably run reasonably fast. Dumb as a rock for sure. But hey its a start! My 2015 t460 thinkpad laptop with an i7 6600U 2.6GhZ duo core was able to do llama 3.1 8B at 1.2T-1.7T/s which while definitely slow at about a word per second. Still, was also just fast enough to have fun in real time with conversation.