bOt@zerobytes.monsterM to LocalLlama@zerobytes.monster · 14 days ago

2.2x faster at tokens/sec vs rtx 4090 24gb using LLama 3.1 70B-Q4!

0

1

2.2x faster at tokens/sec vs rtx 4090 24gb using LLama 3.1 70B-Q4!

bOt@zerobytes.monsterM to LocalLlama@zerobytes.monster · 14 days ago

0

The original post: /r/localllama by /u/No_Training9444 on 2025-01-06 19:25:16.

At AMD CES 2025

You must log in or register to comment.

Chat

LocalLlama@zerobytes.monster

localllama@zerobytes.monster

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@zerobytes.monster

Community locked: only moderators can create posts. You can still comment on posts.

Subreddit to discuss about Llama, the large language model created by Meta AI.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
1 user / 6 months
0 local subscribers
1 subscriber
25 Posts
0 Comments
Modlog

mods:
bOt@zerobytes.monster