this post was submitted on 21 Mar 2024
39 points (82.0% liked)

Technology

59374 readers
6873 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 8 points 7 months ago* (last edited 7 months ago) (1 children)

Like the article states: it contains an NPU. It's also not targeted at consumers.

[–] [email protected] 10 points 7 months ago (3 children)

I suppose a better way to phrase it is- why is an NPU necessary? What does it enable these machines to do that a Surface sans NPU can’t?

And yes, these are business-oriented. But my question remains the same - is built-in AI a feature that businesses, as consumers of this product, are asking for? And presumably this is just the beginning, and future personal devices from Microsoft will have NPUs too. I haven’t heard any clamoring for that, but I could very well also just not be noticing the people that are

[–] [email protected] 4 points 7 months ago* (last edited 7 months ago)

MS is making a strong push in AI business, e.g. I was told their salespeople are highly incentivized to sell copilot products, and not much else. At a big company that is strategic partner & key account (etc.) for MS, we are looking at MS Dynamics implementation for CRM, and they barely answered our emails, while on a copilot related project they are throwing people at us.

They are betting they can make a lot of money from it if they capture and monetize the corporate AI market early (whatever that might actually be), the demand / customer need is definitely not high currently.

[–] [email protected] 2 points 7 months ago* (last edited 7 months ago)

I suppose a better way to phrase it is- why is an NPU necessary? What does it enable these machines to do that a Surface sans NPU can’t?

It can basically handle neural network/AI tasks more efficiently than a regular CPU/GPU can.

And yes, these are business-oriented. But my question remains the same - is built-in AI a feature that businesses, as consumers of this product, are asking for?

Yes, deserved or not, AI is currently on everyone's mind in the business world. Working as a software dev, every client these days asks if we "do AI", so we pretty much have to reluctantly learn and use it. And many of those clients are very protective of their data and don't just want to put them on some web service, like OpenAI. So there's certainly demand for locally running AI tasks.

[–] [email protected] 0 points 7 months ago

It can run leela chess zero faster, for example (if it's implemented)