this post was submitted on 31 Oct 2023
225 points (91.5% liked)

Technology

59207 readers
2520 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 56 points 1 year ago (7 children)

I knew “scary fast” had to mean some sort of processor bump for hardware, but I was secretly hoping they’d kill off the remaining Lightning ports on their keyboards, trackpads, and mice.

And I was hoping they’d finally redesign that god awful mouse. I don’t know how people live with that thing.

load more comments (7 replies)
[–] [email protected] 30 points 1 year ago* (last edited 1 year ago) (2 children)

3 nanometer

That’s a silicon lattice just six atoms thick. What a time to be alive!

[–] [email protected] 59 points 1 year ago (3 children)

Nanometers have actually been a marker of generation for quite a while. 3nm is actually 24. https://en.m.wikipedia.org/wiki/3_nm_process

[–] [email protected] 25 points 1 year ago (1 children)

Intel does it and it's annoying. 7mm lithography is actually 10nm. No idea how they get away with false advertising.

[–] [email protected] 11 points 1 year ago (1 children)

If they do 10nm++++ people also get angry.

[–] [email protected] 5 points 1 year ago

Maybe use anything other than nm then?

[–] [email protected] 18 points 1 year ago* (last edited 1 year ago) (1 children)

That seems... Illegal. Much the same as selling a "foot long" Sub or Hotdog which is only 11".

At the very least it's misleading.

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago) (1 children)

What are you complaining about? We promised you three but you got 11! Those are bonus nanometers just for you.

Since feature size doesn't actually matter, The metric that large scale computer consumers use is application performance. The feature size kind of is just a talking point, it's not really fraud, since it doesn't have a direct impact on the measurable performance that actually matters.

If I had a 20 nanometer chip that performs better than a 7 nanometer chip, I still have the better chip, and I know in large-scale procurement, you often get free sample chips to run your applications on, to see how performant the new architecture will actually be... And that'll drive the bulk of the sales

[–] [email protected] 2 points 1 year ago

It very much does matter. A large driver of pushing to smaller scale is to increase the amount of transistors and traces they can fit in a given space for reasons of both manufacturing and practical issues.

If they tried to make a modern CPU using the manufacturing scale of yesteryear, they'd have to use multiple wafers to make a single chip.

Can you imagine how big a modern CPU (7ish nm) design would end up if it were made using the same scale as even a Pentium Pro/Pentium 2 (300nm)?? They would be 42times larger!! Just try fitting one of those in a laptop. And that's ignoring the timing issues you'd have with the traces being so long between sections of the CPU.

[–] [email protected] 6 points 1 year ago

Wow, I had no clue. TIL

[–] [email protected] 16 points 1 year ago

From Wikipedia: The term "3 nanometer" has no relation to any actual physical feature (such as gate length, metal pitch or gate pitch) of the transistors.

[–] [email protected] 27 points 1 year ago (7 children)

I built a M3 MBP just to see how much money a mxed out unit would be.

M3 14" MBP Max chip with all the cores 128GB RAM 8TB storage

$4700

That's about the cost of my last MBP and iPhone pair, two times over. At that point, why even go for a laptop, vs. what would clearly be a high end desktop station?

[–] [email protected] 22 points 1 year ago* (last edited 1 year ago)

*Wonders what a maxed out MBP costs.

*pics the 14”…

Maxed out 16” is $7,199.- (ex Apple care)

Maxed out 14” is $6,899.- … (I think you missed something)

[–] [email protected] 12 points 1 year ago (3 children)

Am I confused, or are you confidently asserting that desktop systems are objectively superior to laptops?

[–] [email protected] 21 points 1 year ago* (last edited 1 year ago) (2 children)

they are. (unless we're talking about Mac only, which are not as repairable or upgradable)

desktop allow for a far better modularity, and reparability, far more ports, PCIe expansions like sound cards, etc.

If my screen breaks or I'd rather use a bigger one, I just buy a monitor and plug it in. If my CPU dies or is no more enough for my use case, I'll just buy a better one while still using every other component. If I need more hard drives, I'll just buy more SATA cables. If I need better sound, I'll buy a sound card.

those features are dealbreakers. laptops will never be able to compete with a real desktop.

[–] [email protected] 11 points 1 year ago

Desktops are superior even if only for the better cooling options, allowing your chips to sustain higher clockspeeds for longer without the machine sounding like a jet taking off

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago)

Aside from all of that, desktops are also far less constrained. If you have a CPU whose performance scales well with power (ie not an M2 but maybe an M3) you can slap it in a desktop and be able to give it 500 watts of power and a giant ass cooling setup to enable that performance. You can't do this with the physical constraints required of a laptop.

[–] [email protected] 15 points 1 year ago (2 children)

Are you implying they're not? The only reason anyone even buys laptops is because PCs aren't portable. Otherwise PCs are the best.

load more comments (2 replies)
[–] [email protected] 2 points 1 year ago

Not the OP but yes

In terms of performance that is.

[–] [email protected] 7 points 1 year ago (3 children)

At that point, why even go for a laptop, vs. what would clearly be a high end desktop station?

Because you can take that high-end computer with you across the room, on a plane, or anywhere else.

load more comments (3 replies)
[–] [email protected] 2 points 1 year ago (3 children)

Skip apple entirely. The spec out and testing of the new Qualcomm ARM chip releasing in laptops next year looks to have the m3 beat across the board and will definitely end up at a lower price point.

[–] [email protected] 7 points 1 year ago* (last edited 1 year ago) (4 children)

Yes! By all means, buy next years’ mythical chip and instead of this proven one!

load more comments (4 replies)
[–] [email protected] 3 points 1 year ago

That's what I'm waiting for, just that it gets close to Mx performance and has proper Linux support.

load more comments (1 replies)
load more comments (3 replies)
[–] [email protected] 23 points 1 year ago* (last edited 1 year ago) (2 children)

The memory maximums are a tad silly. I’d expect …

  • M3 up to 32gb
  • M3 Pro up to 64gb
  • M3 Max ok, this one is ok

The ray tracing is awesome, but minus that I am not eager to move up from my M1 Max.

[–] [email protected] 24 points 1 year ago* (last edited 1 year ago) (1 children)

The memory maximums are going to be more and more important when it comes to local AI applications.

Take language models for an example

To run a 30b model, you need 24gb of video ram to do it fully on the video card. That's a nvidia 3090 or 4090 today. But in the grand scheme of things, 30b is small. They are going to get much bigger, especially when you want larger contexts which allow the AI to remember more about its interactions with you.

Apples memory is unified, so it can be system ram, or video ram. You'll be able to easily load a 70b model into a MacBook with 64gb of ram for example, where you'd need 2 3090s or 4090s and a hefty PSU on a current Gen non Mac PC (if you even can with just that)

For the moment, things are better optimized for windows and nvidia hardware, but Apple is encroaching on this space, and their huge amounts of video memory will begin to unlock using and training larger and larger models with each hardware generation.

Expect to see nvidia starting to offer higher video ram cards as well for this exact reason. Maybe even cards tailored to that instead of gaming with really high amounts of ram.

[–] [email protected] 2 points 1 year ago (1 children)

I can't see local models or hardware needing to scale much past the sizes we already have. Recent models like mistral have shown that we are still far from saturation at current model sizes.

[–] [email protected] 4 points 1 year ago (1 children)

And we only ever needed 64kb of ram.

Even if we have a lot of room to optimize and grow within what we have, we still have so much more to do.

Fully coherent audio and video synthesis for a scene for example.

And these models are being trained on server farms, but thats just because video memory is so expensive to come by.

We're just starting to crawl, we haven't even started walking yet on where this is going.

load more comments (1 replies)
[–] [email protected] 3 points 1 year ago (1 children)

Doesn't the m2 max allow 196gb of ram? Seems like an odd downgrade. The value in these for me is the unified memory for large ai models, but most consumers may not notice that. Who knows.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

That's the m2 ultra which is only the desktop version right now.

[–] [email protected] 19 points 1 year ago (1 children)

M2 release dates.

  • M2: June 24, 2022
  • M2 Pro and Max: January 17, 2023
  • M2 Ultra: June 13, 2023

Damn Apple.

[–] [email protected] 2 points 1 year ago

I would expect those machines should have launched earlier than they did: everything was pushed back as a result of supply chain issues.

I am making assumptions here but I've heard similar speculation from several places.

[–] [email protected] 10 points 1 year ago (1 children)

What is "dynamic caching"? The article mentions that iris new, but nothing more.

[–] [email protected] 7 points 1 year ago

Based on my 60 seconds reading on it, onboard GPUs typically share the systems RAM. It is usually a fixed amount from my understanding. Dynamic caching seems to allow the GPU to only consume what it needs. Without knowing more, I'm guessing this means it frees up more RAM for the system instead of holding a fixed chunk in reserve for the GPU, or, on the other side, allows the GPU to use more RAM than some predetermined fixed amount.

According to Apple's press release, the GPUs in the new Macs are already faster and more efficient than those that came before them. But they go further thanks to their support for Dynamic Caching, a feature that "unlike traditional GPUs, allocates the use of local memory in hardware in real time."

What does that mean? Apple says that "with Dynamic Caching, only the exact amount of memory needed is used for each task. This is an industry first, transparent to developers, and the cornerstone of the new GPU architecture."

https://www.imore.com/mac/dynamic-caching-and-its-m3-chips-could-be-the-secret-to-apples-mac-gaming-plans

[–] [email protected] 8 points 1 year ago (1 children)

Do we have a m3 air now? I can't find it. I was planning to buy m2 air but now we have m3 so probably best to wait ?

[–] [email protected] 10 points 1 year ago

Not yet, it’s just the MacBook Pro and iMac for now

[–] [email protected] 6 points 1 year ago (1 children)

I was kinda bored for this announcement. I have a M2 Pro MBP for work and I really have no desire to get anything faster.

I was hoping for a new iPad Mini announcement

[–] [email protected] 18 points 1 year ago (1 children)

I’m hoping for a new iPhone mini announcement…

[–] [email protected] 9 points 1 year ago (1 children)

I’m hoping for an Apple Watch mini announcement*

*-not really, I just wanted to feel like I was a part of something for a moment there…

[–] [email protected] 5 points 1 year ago (1 children)

I'm am too wanting to be a part of this... So... Mini mac studio would be nice

[–] [email protected] 3 points 1 year ago

So… a Mac mini…? 😀

[–] [email protected] 2 points 1 year ago (5 children)

pity qualcomm has just wiped the floor with them. even with the new M3 it's not even close I believe. please correct me if I'm wrong (who am I kidding you're gunna correct me)

load more comments (5 replies)
load more comments
view more: next ›