69
submitted 16 hours ago by Gaywallet@beehaw.org to c/technology@beehaw.org
you are viewing a single comment's thread
view the rest of the comments
[-] t3rmit3@beehaw.org 14 points 15 hours ago* (last edited 15 hours ago)

What do you believe would make this particular use prone to errors?

[-] knightly@pawb.social 1 points 6 hours ago

The use of LLMs instead of someone that can actually understand context.

[-] GetOffMyLan@programming.dev 2 points 5 hours ago

One of LLMs main strengths over traditional text analysis tools is the ability to "understand" context.

They are bad at generating factual responses. They are amazing at analysing text.

[-] knightly@pawb.social 1 points 4 hours ago

LLMs neither understand nor analyze text. They are statistical models of the text they were trained on. A map of language.

And, like any map, they should not be confused for the territory they represent.

If you admit that they have issues with facts, why would you assume that the randomly generated facts their "analysis" produces must be accurate?

[-] GetOffMyLan@programming.dev 2 points 4 hours ago* (last edited 4 hours ago)

I mean they literally do analyze text. They're great at it. Give it some text and it will analyze it really well. I do it with code at work all the time.

Because they are two completely different tasks. Asking them to recall information from their training is a very bad use. Asking them to analyze information passed into them is what they are great at.

Give it a sample of code and it will very accurately analyse and explain it. Ask it to generate code and the results are wildly varied in accuracy.

I'm not assuming anything you can literally go and use one right now and see.

[-] apotheotic@beehaw.org 1 points 2 hours ago

The person you're replying to is correct though. They do not understand, they do not analyse. They generate (roughly) the most statistically likely answer to your prompt, which may very well end up being text representing an accurate analysis. They might even be incredibly reliable at doing so. But this person is just pushing back against the idea of these models actually understanding or analysing. Its slightly pedantic, sure, but its important to distinguish in the world of machine intelligence.

[-] GetOffMyLan@programming.dev 1 points 1 hour ago

I literally quoted the word for that exact reason. It just gets really tiring when you talk about AIs and someone always has to make this point. We all know they don't think or understand in the same way we do. No one gains anything by it being pointed out constantly.

[-] apotheotic@beehaw.org 1 points 1 hour ago

You said "they literally do analyze text" when that is not, literally, what they do.

And no, we don't "all know" that. Lay persons have no way of knowing whether AI products currently in use have any capacity for genuine understanding and reasoning, other than the fact that the promotional material uses words like "understanding", "reasoning", "thought process", and people talking about it use the same words. The language we choose to use is important!

[-] GetOffMyLan@programming.dev 1 points 24 minutes ago* (last edited 18 minutes ago)

No it's not. It's pedantic and arguing semantics. It is essentially useless and a waste of everyone's time.

It applies a statistical model and returns an analysis.

I've never heard anyone argue when you say they used a computer to analyse it.

It's just the same AI bad bullshit and it's tiring in every single thread about them.

load more comments (4 replies)
load more comments (7 replies)
load more comments (7 replies)
this post was submitted on 21 Oct 2024
69 points (100.0% liked)

Technology

37666 readers
429 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS