misk@sopuli.xyz to Technology@lemmy.worldEnglish · 2 months agoOpenAI and others seek new path to smarter AI as current methods hit limitationswww.reuters.comexternal-linkmessage-square15fedilinkarrow-up157arrow-down14cross-posted to: technology@lemmy.ml
arrow-up153arrow-down1external-linkOpenAI and others seek new path to smarter AI as current methods hit limitationswww.reuters.commisk@sopuli.xyz to Technology@lemmy.worldEnglish · 2 months agomessage-square15fedilinkcross-posted to: technology@lemmy.ml
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up2·2 months agoYep. 32B fits on a “consumer” 3090, and I use it every day. 72B will fit neatly on 2025 APUs, though we may have an even better update by then. I’ve been using local llms for a while, but Qwen 2.5, specifically 32B and up, really feels like an inflection point to me.
Yep.
32B fits on a “consumer” 3090, and I use it every day.
72B will fit neatly on 2025 APUs, though we may have an even better update by then.
I’ve been using local llms for a while, but Qwen 2.5, specifically 32B and up, really feels like an inflection point to me.