kelvie@lemmy.ca to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Is there a good reason why AMD APUs just aren't used with massive amounts of (V)RAM just like the Mac M2 is?

22

Is there a good reason why AMD APUs just aren't used with massive amounts of (V)RAM just like the Mac M2 is?

kelvie@lemmy.ca to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?

Chat

rufus
link
fedilink
English
arrow-up
1·
1 year ago
What’s the memory bandwith on the AMD platform?

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

3 users / day
53 users / week
121 users / month
273 users / 6 months
50 local subscribers
2.39K subscribers
232 Posts
916 Comments
Modlog