373
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 27 Dec 2024
373 points (95.2% liked)
Technology
60148 readers
2039 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
Hey, would you have a reference for this? I'd love to read it. Does it apply to deep neural nets? And/or recurrent NNs?
There is this 2023 study from Stanford which states AI likely do not have emergent abilities LINK
And there is this 2020 study by.... OpenAI... which states the error rate is predictable based on 3 factors, that AI cannot cross below the line or approach 0 error rate without exponentially increasing costs several iterations beyond current models, lending to the idea that they're predictable to a fault LINK
There is another paper by DeepMind in 2022 that comes to the conclusion that even at infinite scales it can never approach below 1.69 irreducable error LINK
This all lends to the idea that AI lacks the same Emergent behavior in Human Language.