425

Google's AI-driven Search Generative Experience have been generating results that are downright weird and evil, ie slavery's positives.

you are viewing a single comment's thread
view the rest of the comments
[-] Stoneykins@mander.xyz 8 points 1 year ago* (last edited 1 year ago)

There needs to be like an information campaign or something... The average person doesn't realize these things say what they think you want to hear, and they are buying into hype and think these things are magic knowledge machines that can tell you secrets you never imagined.

I mean, I get the people working on the LLMs want them to be magic knowledge machines, but it is really putting the cart before the horse to let people assume they already are, and the little warnings that some stuff at the bottom of the page are inadequate.

[-] TheRealKuni@lemmy.world 5 points 1 year ago

I had a friend who read to me this beautiful thing ChatGPT wrote about an idyllic world. The prompt had been something like, “write about a world where all power structures are reversed.”

And while some of the stuff in there made sense, not all of it did. Like, “in schools, students are in charge and give lessons to the teachers” or something like that.

But she was acting like ChatGPT was this wise thing that had delivered a beautiful way for society to work.

I had to explain that, no, ChatGPT gave the person who made the thing she shared what they asked for. It’s not a commentary on the value of that answer at all, it’s merely the answer. If you had asked ChatGPT to write about a world where all power structures were double what they are now, it would give you that.

[-] fsmacolyte@lemmy.world 1 points 1 year ago

I mean, on the ChatGPT site there's literally a disclaimer along the bottom saying it's able to say things that aren't true...

[-] Flambo@lemmy.world 4 points 1 year ago* (last edited 1 year ago)

people assume they already are [magic knowledge machines], and the little warnings that some stuff at the bottom of the page are inadequate.

You seem to have missed the bottom-line disclaimer of the person you're replying to, which is an excellent case-in-point for how ineffective they are.

[-] stopthatgirl7@kbin.social -1 points 1 year ago

Unfortunately, people are stupid and don’t pay attention to disclaimers.

And, I might be wrong, but didn’t they only add those in recently after folks started complaining and it started making the news?

[-] fsmacolyte@lemmy.world 1 points 1 year ago

I feel like I remember them being there since January of this year, which is when I started playing with ChatGPT, but I could be mistaken.

this post was submitted on 24 Aug 2023
425 points (88.6% liked)

Technology

60148 readers
2039 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS