Technology

68245 readers

4237 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

MIT introduced a smart assistant for LLM (www.techexplorist.com)

submitted 2 days ago by [email protected] to c/[email protected]

3 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 2 days ago (1 children)

This framework was tested on nine complex challenges. It achieved an 85 percent success rate, whereas the best baseline only achieved a 39 percent success rate. This suggests its applications in various multistep planning tasks, such as scheduling airline crews or managing machine time in a factory.

85% isn't good. It's a vast improvement, but it's not a good rate at scale. If you have 100,000 actions, 15,000 are wrong. If you have 1M customers, 150K are calling customer support.

Also, even if we're talking about smaller scales like scheduling airline crews or managing machine time, how is AI not overkill? You have to have relatively massive amounts of hardware for the payoff of what a handful of people could do. Or a "dumb" algorithm. Or a signup sheet. And now we're adding additional computing overhead?

AI is still a solution in search of a problem.

[–] [email protected] 3 points 2 days ago

Well yeah, but the article is about a paper that’s showing a strategy to improve planning capabilities in comparison to using LLMs as they are currently. It’s just research, they’re not saying to use that in production now, and I’d say it isn’t something the researchers are even worried about for this particular artifact.