[-] doodlebob@lemmy.world 3 points 4 weeks ago

I think they mentioned on their discord that it's in the pipeline

[-] doodlebob@lemmy.world 3 points 4 weeks ago

I really wish there was an update feature built into OWUI!

[-] doodlebob@lemmy.world 2 points 8 months ago* (last edited 8 months ago)

Do you know if there is openai API compatibility? More specifically I'd like to get home assistant to interact with the LLM via the custom OpenAI hacs addon

[-] doodlebob@lemmy.world 2 points 10 months ago

I think you're right. Saw a post on Reddit basically mentioning the same things I'm seeing.

It looks like autoawq supports it but it might be an issue with how oobabooga implements it or something...

[-] doodlebob@lemmy.world 2 points 10 months ago

I have two 3090 Turbo GPUs and it seems like oobabooga doesn't split the load between the two cards when I try to run TheBloke/dolphin-2.7-mixtral-8x7b-AWQ.

Does anyone know how to make text generation webui use both cards? Do I need an nvlink between the two cards?

[-] doodlebob@lemmy.world 1 points 10 months ago

I tried this but much prefer to use oogabooga text generation webui. Couldn't get your solution to work in unraid for whatever reason

[-] doodlebob@lemmy.world 1 points 10 months ago

Check out onju voice!

[-] doodlebob@lemmy.world 6 points 10 months ago

I'm sure that's not that big of a deal to some people. For example, I'm mainly using LLMs for use in my home assistant instance

[-] doodlebob@lemmy.world 4 points 10 months ago

Do you know if there is anything that locks up to this that will automatically download the music they recommend?

It would be cool to have an app where if you like the track, you give it a thumbs up, but if you don't you give it a thumbs down and the track is deleted automatically

[-] doodlebob@lemmy.world 23 points 11 months ago

You're gonna make me look it up myself?!

[-] doodlebob@lemmy.world 9 points 1 year ago

You should probably also sync them. I use orbital sync for this. https://github.com/mattwebbio/orbital-sync

view more: next ›

doodlebob

joined 2 years ago