kelvie@lemmy.ca to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Is there a good reason why AMD APUs just aren't used with massive amounts of (V)RAM just like the Mac M2 is?

22

Is there a good reason why AMD APUs just aren't used with massive amounts of (V)RAM just like the Mac M2 is?

kelvie@lemmy.ca to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?

Chat

rufus
link
fedilink
English
arrow-up
1·
1 year ago
What’s the memory bandwith on the AMD platform?

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

15 users / day
16 users / week
21 users / month
363 users / 6 months
46 local subscribers
2.24K subscribers
224 Posts
871 Comments
Modlog