bOt@zerobytes.monsterM to LocalLlama@zerobytes.monster · 14 days ago

AMD Ryzen AI Max+ 395 Llama 3.1 70B-Q4 twice as fast RTX 4090

0

1

AMD Ryzen AI Max+ 395 Llama 3.1 70B-Q4 twice as fast RTX 4090

bOt@zerobytes.monsterM to LocalLlama@zerobytes.monster · 14 days ago

0

The original post: /r/localllama by /u/Any_Pressure4251 on 2025-01-06 19:33:05.

https://preview.redd.it/9ip76nskdfbe1.png?width=1259&format=png&auto=webp&s=4c85c54437b67cd6fa1f13c7d60dafafa3962385

Looks like game is on for fast inference for consumers.

You must log in or register to comment.

Chat

LocalLlama@zerobytes.monster

localllama@zerobytes.monster

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@zerobytes.monster

Community locked: only moderators can create posts. You can still comment on posts.

Subreddit to discuss about Llama, the large language model created by Meta AI.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
1 user / 6 months
0 local subscribers
1 subscriber
25 Posts
0 Comments
Modlog

mods:
bOt@zerobytes.monster