324

cross-posted from: https://hexbear.net/post/2609634

Hmmmm… I don’t remember that Beatles song

you are viewing a single comment's thread
view the rest of the comments
[-] assaultpotato@sh.itjust.works 5 points 7 months ago* (last edited 7 months ago)

Depends on the temperature in the LLM/context, which I'm assuming google will have set quite low for this.

[-] TrickDacy@lemmy.world 2 points 7 months ago
[-] assaultpotato@sh.itjust.works 5 points 7 months ago

Yeah, it's kind of a measure of randomness for LLM responses. A low temperature makes the LLM more consistent and more reliable, a higher temperature makes it more "creative". Same prompt on low temperature is more likely to be repeatable, high temperature introduces a higher risk of hallucinations, etc.

Presumably Google's "search suggestions" are done on a very low temperature, but that doesn't prevent hallucinations, just makes it less likely.

this post was submitted on 24 May 2024
324 points (87.0% liked)

shitposting

1682 readers
319 users here now

Rules •1. No Doxxing •2. No TikTok reposts •3. No Harassing •4. Post Gore at your own discretion, Depends if its funny or just gore to be an edgelord.

founded 3 years ago
MODERATORS