makeasnek@lemmy.ml to AI@lemmy.mlEnglish · 17 days agoLLM ASICs on USB sticks?lemmy.mlimagemessage-square10fedilinkarrow-up126arrow-down16file-textcross-posted to: aicompanions@lemmy.world
arrow-up120arrow-down1imageLLM ASICs on USB sticks?lemmy.mlmakeasnek@lemmy.ml to AI@lemmy.mlEnglish · 17 days agomessage-square10fedilinkfile-textcross-posted to: aicompanions@lemmy.world
Source: nostr https://snort.social/nevent1qqsg9c49el0uvn262eq8j3ukqx5jvxzrgcvajcxp23dgru3acfsjqdgzyprqcf0xst760qet2tglytfay2e3wmvh9asdehpjztkceyh0s5r9cqcyqqqqqqgt7uh3n Paper: https://arxiv.org/abs/2406.02528
minus-squareChrobinlinkfedilinkarrow-up1·16 days agoI have never worked on machine learning, what does the B stand for? Billion? Bytes?
minus-squareFischlinkfedilinkEnglisharrow-up2·16 days agoI think it’s how many billion parameters the model has
I have never worked on machine learning, what does the B stand for? Billion? Bytes?
I think it’s how many billion parameters the model has
Thanks!