submitted 10 months ago by OpticalMoose@discuss.tchncs.de to c/localllama@sh.itjust.works

6 comments fedilink hide all child comments

This is an interesting demo, but it has some drawbacks I can already see:

It's Windows only (maybe Win11 only, the documentation isn't clear)
It only works with RTX 30 series and up
It's closed source, so you have no idea if they're uploading your data somewhere

The concept is great, having an LLM to sort through your local files and help you find stuff, but it seems really limited.

I think you could get the same functionality(and more) by writing an API for text-gen-webui.

you are viewing a single comment's thread
view the rest of the comments

[-] librecat@lemmy.basedcount.com 6 points 10 months ago

Interesting that it only works on windows, a lot of AI projects I've seen have been the other way around.

this post was submitted on 14 Feb 2024

17 points (90.5% liked)

LocalLLaMA

2388 readers

3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS