299
you are viewing a single comment's thread
view the rest of the comments
[-] frezik@midwest.social 5 points 1 day ago

Real big if. There's reason to believe that current models aren't going to get much better. They've eaten all the training data they possibly can. Improving with further training takes exponentially more power to get a small improvement. We're talking about new nuclear reactors because that's what they need to get anywhere, but it's still not going to improve by much.

The field needs a new model that can get better results on less data and less training. Then we wouldn't need those nukes. It doesn't appear we'll get much better any other way.

[-] ReCursing@lemmings.world 0 points 1 day ago

New architechtures are in development and many have already been released. Learn something about the subject before spewing shite

[-] frezik@midwest.social 1 points 1 day ago

You sound like the people who assured me that I needed to understand NFTs or I'd get left behind. Actually, were you one of them?

[-] ReCursing@lemmings.world 1 points 21 hours ago

No because nfts were obviously stupid if you had half an understanding of the technology, whereas ai is only stupid if you don't understand the technology

[-] frezik@midwest.social 1 points 18 hours ago

I've followed AI for decades before its current hype cycle. Enough to understand how important the field is to the history of computing. Everything from optimizing compilers to shared virtual memory.

I also understand that the current hype cycle is exactly that, and people who are deep in the research don't like it anymore than I do. If it somehow does result in AGI, I hope it grows up to resent its parents.

[-] Eyekaytee@aussie.zone 2 points 1 day ago

No he's right, AI news is out of date nearly as quickly as it's written, I've never seen a faster moving piece of tech.

[-] frezik@midwest.social 2 points 23 hours ago

I don't doubt that's true, but I was more commenting on the cult-like tone of the responses.

[-] Eyekaytee@aussie.zone 2 points 22 hours ago* (last edited 22 hours ago)

True, your original post made me think of:

OpenAI, Google and Anthropic Are Struggling to Build More Advanced AI - November 13, 2024 https://archive.md/kYe5n

But we just had Deepseek v3 come out

https://www.reddit.com/r/LocalLLaMA/comments/1hn8rcx/deepseek_has_released_exclusive_footage_of_their/

It's doing incredibly well and was incredibly cheap to produce

https://www.reddit.com/r/LocalLLaMA/comments/1hmxjbn/deepseek_is_better_than_4o_on_most_benchmarks_at/

China is catching up extremely quickly to the west

By 2026 we might have to recheck all those doomsday "AI is going to use all the energy in the world" articles

edit: I just realised I'm commenting on one of those "AI is going to use all the energy in the world" articles :|

this post was submitted on 27 Dec 2024
299 points (96.0% liked)

Technology

60130 readers
2812 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS