784

Anyone who has been surfing the web for a while is probably used to clicking through a CAPTCHA grid of street images, identifying everyday objects to prove that they're a human and not an automated bot. Now, though, new research claims that locally run bots using specially trained image-recognition models can match human-level performance in this style of CAPTCHA, achieving a 100 percent success rate despite being decidedly not human.

ETH Zurich PhD student Andreas Plesner and his colleagues' new research, available as a pre-print paper, focuses on Google's ReCAPTCHA v2, which challenges users to identify which street images in a grid contain items like bicycles, crosswalks, mountains, stairs, or traffic lights. Google began phasing that system out years ago in favor of an "invisible" reCAPTCHA v3 that analyzes user interactions rather than offering an explicit challenge.

Despite this, the older reCAPTCHA v2 is still used by millions of websites. And even sites that use the updated reCAPTCHA v3 will sometimes use reCAPTCHA v2 as a fallback when the updated system gives a user a low "human" confidence rating.

top 50 comments
sorted by: hot top controversial new old
[-] Draconic_NEO@lemmy.world 13 points 6 days ago* (last edited 6 days ago)

CAPTCHA doesn't stop bots, and let us be honest, it never really did. It frustrated the hell out of people though, and caused people to waste time doing these challenges. Meanwhile even before AI bad actors and bots could get past it simply by using captcha solver services run by exploited humans solving captchas for the service.

It's a display of security theater meant to make normies feel safe but in reality doesn't stop most bad actors.

[-] mosiacmango@lemm.ee 90 points 1 week ago* (last edited 1 week ago)

This is actually a good sign for self driving. Google was using this data as a training set for Waymo. If AI is accurately identifying vehicles and traffic markings, it should be able to process interactions with them easier.

[-] iAmTheTot@sh.itjust.works 71 points 1 week ago

As I understand it, the point of those captchas was never really "bots can't identify these things" (though you're right on that it was used to train). They use cursor movement, clicks, and other behaviours while you're solving it to detect if you are a bot or not.

[-] Grimy@lemmy.world 43 points 1 week ago

The image choosing was always just to train their own bots

load more comments (5 replies)
[-] grue@lemmy.world 32 points 1 week ago

The annoying thing is that they held us hostage for our free labor, but the results are proprietary for Google's benefit only.

That training data ought to be forced to be made freely available to the public, since we're the ones who actually created it.

load more comments (6 replies)
[-] communism@lemmy.ml 77 points 1 week ago

And yet I can't beat the CAPTCHAs because reCAPTCHA doesn't like VPNs lol

[-] Draconic_NEO@lemmy.world 26 points 1 week ago

Captcha these days isn't even really a CAPTCHA in the traditional sense since most of the work it does is based on filtering of IP and browser fingerprinting, with a certain level of gamification because the goal is not just to keep out the people they fight against, but to waste their time, would work great if it didn't waste normal people's time, while real bad actors have easy ways to get around it.

load more comments (3 replies)
[-] samus12345@lemmy.world 55 points 1 week ago

So can we stop using those damn things? They're super annoying!

[-] ohellidk@sh.itjust.works 16 points 1 week ago

I'm kind of hoping the AI permanently beats them. I hate them too.

load more comments (1 replies)
[-] Blackmist@feddit.uk 43 points 1 week ago

Aren't these Captchas designed to get training data for AI models anyway?

"System does what it was designed to do" doesn't feel that surprising...

load more comments (7 replies)
[-] pixxelkick@lemmy.world 42 points 1 week ago

Well yeah, I'd hope so, that's the entire point.

Catcha's data collection always was with the intent for training ai on these skills. That's "the point" of them.

It's reasonable to expect that the older version of captchas can now be beaten by modern ai, because they're often literally trained on that exact data to beat it.

Captcha effectively is free to use on websites as a tool because the data collection is the "payment", they then license that data out to people like OpenAI to train with for stuff like image recognition.

It's why ai is progressing so fast, captchas are one of humanity's long term collected data silos that are very full now.

We are going to have to keep progressing the complexity of catches as it will be the only way to catch modern AIs, and in turn it will collect more data to improve it.

[-] MIDItheKID@lemmy.world 12 points 1 week ago

Yeah, my understanding is that these capchas were made to harvest data to use for AI/Autopilot driven cars. That's why they are always having you identify motorcycles, bycicles, crosswalks, stoplights, busses, etc. It's all stuff that automatic driving cars have had a hard time identifying.

load more comments (5 replies)
[-] PenisDuckCuck9001@lemmynsfw.com 39 points 1 week ago* (last edited 1 week ago)

I fucking hate these. I've seen old people that don't know any better get stuck on these for at least 30 minutes.

[-] pyre@lemmy.world 24 points 1 week ago

it's super ableist. if someone has poor vision or colorblindness chances are they're going to miss things.

[-] Dark_Arc@social.packetloss.gg 2 points 6 days ago

FYI as someone that's colorblind these captcha's don't seem to have anything specially relevant to being colorblind in them.

Now if they start showing me a dozen traffic cones and asking me to pick the green one, we might have a problem.

[-] Dozzi92@lemmy.world 24 points 1 week ago

I have regular everything and I still fuck them up. "click the ones with a fire hydrant". But a tiny piece of fire hydrant is spilling into another box. Does it count? Does it not count? Good luck!!

I had one the other day that was deep fried jpegs to the max. Like, what the fuck am I supposed to do.

load more comments (2 replies)
load more comments (2 replies)
load more comments (1 replies)
[-] sirico@feddit.uk 35 points 1 week ago

When it's asking for motorcycles but it's clearly a scooter

[-] ripcord@lemmy.world 26 points 1 week ago

Or, like, "there's the bottom 10% of a traffic light in this one. Do I click that box? Ia that supposed to count?"

load more comments (17 replies)
[-] jayandp@sh.itjust.works 18 points 1 week ago

That tip of a handle bar that makes you wonder if that square counts or not.

load more comments (2 replies)
[-] dumbass@leminal.space 13 points 1 week ago

I had one with one of those Motorcycles with the long handles, apparently they aren't part of the bike, but the dudes foot holding it up is.

load more comments (1 replies)
load more comments (1 replies)
[-] tarius@lemmy.ml 29 points 1 week ago

Buster is awesome to get past recaptcha. I use it with my own Speech to Text API key since its free from Google. Using Google to beat Google.

https://github.com/dessant/buster

load more comments (3 replies)
[-] superkret@feddit.org 27 points 1 week ago* (last edited 1 week ago)

Wait, so if a visitor fails the v3 Captcha, v2 is used as a fallback?
That makes absolutely no sense.

[-] cygnus@lemmy.ca 27 points 1 week ago

V3 isn't necessarily more effective than V2, it's just less obtrusive.

Not quite: it'll drop a v2 captcha for you to solve when a v3 one can't clearly classify you one way or another.

So if v3 isn't entirely sure you're human, it'll make you do a v2.

load more comments (3 replies)
[-] JoMomma@lemm.ee 24 points 1 week ago

But, I cannot pass those 50% of the time... what does that mean?

[-] hOrni@lemmy.world 12 points 1 week ago
load more comments (1 replies)
load more comments (5 replies)
[-] cheddar@programming.dev 18 points 1 week ago

My score is lower.

[-] GoofSchmoofer@lemmy.world 18 points 1 week ago

I can see a future where the Internet is completely run by bots and AI to the point where no human actually uses the Internet anymore.

It's like an island that gets overrun with rats - there are just too many to deal with so you leave.

[-] lando55@lemmy.world 13 points 1 week ago

Some believe this happened years ago. Check out Dead Internet Theory.

load more comments (5 replies)
[-] MonkderVierte@lemmy.ml 17 points 1 week ago

Cool, so can Google shut it down now?

[-] rainman@lemmy.myserv.one 16 points 1 week ago

I fail more of those checks then these AI bots do. Surreal.

[-] apostrofail@lemmy.world 1 points 6 days ago

than* these AI bots

load more comments (6 replies)
[-] madjo@feddit.nl 13 points 1 week ago* (last edited 1 week ago)

Meanwhile I sometimes fail those. I have been locked out of applications because I missed a square of a bus, or perhaps because I like to be efficient in my mouse cursor movements. I ducking hate CAPTCHAs.

[-] TommySoda@lemmy.world 13 points 1 week ago

I mean, we literally train them by completing the CAPTCHAs. Why do you think you were picking things like bikes, traffic lights, cars, and busses? The only question now is what's next...

load more comments (3 replies)
load more comments
view more: next ›
this post was submitted on 27 Sep 2024
784 points (98.4% liked)

Technology

58492 readers
3900 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS