425

Google's AI-driven Search Generative Experience have been generating results that are downright weird and evil, ie slavery's positives.

(page 2) 50 comments
sorted by: hot top controversial new old
[-] livus@kbin.social 5 points 1 year ago* (last edited 1 year ago)

Obviously it doesn't "think" any of these things. It's just a machine repeating back a plausible mimicry.

What does scare me though is what google execs think.
They will be tweaking it to remove obvious things like praise of Hitler, because PR, but what about all the other stuff?

Like, most likely it will be saying things like what a great guy Masaji Kitano was for founding Green Cross and being such an experimental innovator, and no one will bat an eye because they haven't heard of him.

As we outsource more and more of our research and fact checking to machines, errors in knowledge are going to be reproduced and reinforced. Like how Cinderella now has "glass" slippers.

[-] autotldr@lemmings.world 4 points 1 year ago

This is the best summary I could come up with:


Not only has it been caught spitting out completely false information, but in another blow to the platform, people have now discovered it's been generating results that are downright evil.

Case in point, noted SEO expert Lily Ray discovered that the experimental feature will literally defend human slavery, listing economic reasons why the abhorrent practice was good, actually.

That enslaved people learned useful skills during bondage — which sounds suspiciously similar to Florida's reprehensible new educational standards.

The pros included the dubious point that carrying a gun signals you are a law-abiding citizen, which she characterized as a "matter of opinion," especially in light of legally obtained weapons being used in many mass shootings.

Imagine having these results fed to a gullible public — including children — en masse, if Google rolls the still-experimental feature out more broadly.

But how will any of these problems be fixed when the number of controversial topics seems to stretch into the horizon of the internet, filled with potentially erroneous information and slanted garbage?


The original article contains 450 words, the summary contains 170 words. Saved 62%. I'm a bot and I'm open source!

[-] andallthat@lemmy.world 2 points 1 year ago

For the US in the list of countries starting with M, maybe too many 'Murica memes in the training set?

load more comments
view more: ‹ prev next ›
this post was submitted on 24 Aug 2023
425 points (88.6% liked)

Technology

60148 readers
2876 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS