this post was submitted on 03 Dec 2024
242 points (97.6% liked)

Technology

60052 readers
3344 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
242
Intel's $249 Arc B580 is the GPU we've begged for since the pandemic | PCWorld (www.pcworld.com)
submitted 2 weeks ago by [email protected] to c/[email protected]
88 comments fedilink hide all child comments
 

If even half of Intel's claims are true, this could be a big shake up in the midrange market that has been entirely abandoned by both Nvidia and AMD.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 2 weeks ago* (last edited 2 weeks ago) (2 children)

An LLM card with quicksync would be the kick I need to turn my n100 mini into a router. Right now, my only drive to move is that my storage is connected via usb. SATA is just not enough value for a whole new box. £300 for Ollama, much faster ml in immich etc and all the the transcodes I could want would be a "buy now figure the rest out later" moment.

[–] [email protected] 4 points 2 weeks ago (1 children)

Oh also you might look at Strix Halo from AMD in 2025?

Its IGP is beefy enough for LLMs, and it will be WAY lower power than any dGPU setup, with enough vram to be "sloppy" and run stuff in parallel with a good LLM.

[–] [email protected] 2 points 2 weeks ago

*adds to wishlist

[–] [email protected] 2 points 2 weeks ago (1 children)

You could get that with 2x B580s in a single server I guess, though yoi could have already done that with the A770s.

[–] [email protected] 3 points 2 weeks ago (1 children)

... That's nuts. I only just graduated to a mini from a pi, I didnt consider a dual GPU setup. Arbitrary budget aside, I should have added an "idle power" constraint too. Reasonable to assume that as soon as LLMs get involved all concept of "power efficient" goes out the window. Don't mind me, just wishing for a unicorn.

[–] [email protected] 3 points 2 weeks ago

Strix Halo is your unicorn, idle power should be very low (assuming AMD VCE is OK over quicksync)