RTX 5090 rumored to have 1.8 TB/s memory bandwidth

bOt@zerobytes.monsterM to LocalLlama@zerobytes.monster · 14 days ago

The original post: /r/localllama by /u/TechNerd10191 on 2025-01-06 15:20:42.

As per this article the 5090 is rumored to have 1.8 TB/s memory bandwidth and 512 bit memory bus - which makes it better than any professional card except A100/H100 which have HBM2/3 memory, 2 TB/s memory bandwidth and 5120 bit memory bus.

Even though the VRAM is limited to 32GB (GDDR7), it could be the fastest for running any LLM <30B at Q6.

You must log in or register to comment.

Chat

LocalLlama@zerobytes.monster

localllama@zerobytes.monster

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@zerobytes.monster

Community locked: only moderators can create posts. You can still comment on posts.

Subreddit to discuss about Llama, the large language model created by Meta AI.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
1 user / 6 months
0 local subscribers
1 subscriber
25 Posts
0 Comments
Modlog

mods:
bOt@zerobytes.monster