239
you are viewing a single comment's thread
view the rest of the comments
[-] Ilovethebomb@lemm.ee 3 points 2 days ago
[-] whatwhatwhatwhat@lemmy.world 9 points 2 days ago

I run tech for a midsize business, and consult for several small businesses. Aside from one 4-person company, all of the businesses I oversee found it less expensive to host their own LLM in Azure than to pay for OpenAI’s subscriptions. I’m talking 10% of the cost of subscriptions for the same functionality.

The midsize business in particular has only seen measurable benefit from more specialized/global applications of “AI” tools, such as integrating machine learning into data analytics. There are a ton of people who use the LLM chat, but I think the mishaps caused by the LLM may have undone any efficiency gains. Either way, I’m sure glad they’re not paying hundreds of thousands of dollars annually for it.

[-] dragonlobster@programming.dev 1 points 2 days ago

Lol, well obviously it would be cheaper to host an LLM that is smaller. Imagine the cost of hosting o1

[-] whatwhatwhatwhat@lemmy.world 1 points 2 days ago

Fair. We’re using 4o and o1-mini right now, because access to the full o1 is waitlisted in Azure. However based on some brief review of their pricing for o1, I’d say we’re still going to save a metric fuckton of money compared to per-user subscriptions.

[-] Moobythegoldensock@lemm.ee 3 points 2 days ago

Any of the businesses that have hopped on the AI train. $200/month is basically the price of a single Indian call center employee. A company can pay for the AI subscription and fire 90% of the call center, using humans only for escalation.

[-] fluxion@lemmy.world 1 points 2 days ago

Businesses that think shoving AI tools down everyone's throat will create superior productivity so they can lay off workers

this post was submitted on 06 Jan 2025
239 points (96.1% liked)

Technology

60319 readers
3615 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS