overview for Zrybew

Microsoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism in c/[email protected]

[–] [email protected] 1 points 4 months ago (3 children)

Yeah... Why does it sound dumb in so many level?

Scientists propose converting natural gas into hydrogen directly in gas fields in c/[email protected]

[–] [email protected] 34 points 5 months ago

We're about to make Fracking look like a great idea 😂

Microsoft is warping the PC industry into something unrecognizable in c/[email protected]

[–] [email protected] 3 points 5 months ago (1 children)

Many won't. Btw, Adobe just joined the party: https://apple.news/Azi4JUBMZQg-MVqYTrv-5jw

Microsoft is warping the PC industry into something unrecognizable in c/[email protected]

[–] [email protected] 2 points 5 months ago (3 children)

LLMs performance are getting closer to plateau due to lack of data easily available. OpenAi is going around trying to license some data, but it won't be enough.

The company with more touch points with users is better positioned to transform these into Data Probes. Msft has windows, Apple has iOS and Google... Well Google is fucked because the other two have OS level access and can restrict what Google collects.

Now that LLM Foundation models are out, the game will be "who can get the most data" to retrain, optimise and ultimately monetise these models. And there's another whole "can of worms" with the legality of training models with unlicensed data collected trough "system snapshots". I.e.: Collecting NY Times data through windows snapshots of users that visit the site.