petsoi to Linux@lemmy.ml · 2 days agoRunning Generative AI Models Locally with Ollama and Open WebUI - Fedora Magazinefedoramagazine.orgexternal-linkmessage-square19fedilinkarrow-up177arrow-down116
arrow-up161arrow-down1external-linkRunning Generative AI Models Locally with Ollama and Open WebUI - Fedora Magazinefedoramagazine.orgpetsoi to Linux@lemmy.ml · 2 days agomessage-square19fedilink
minus-squaretheshatterstone54@feddit.uklinkfedilinkarrow-up4·1 day agoPersonally I’d just recommend either Alpaca or GPT4All, both of which are on Flathub and much easier to set up (or at least GPT4All is; I haven’t tested Alpaca yet).
minus-squareAshley@lemmy.calinkfedilinkarrow-up1·8 hours agoAlpaca is great, I can even run it on my oneplus 6t, albeit slowly and the max size I got running was llama 7b
Personally I’d just recommend either Alpaca or GPT4All, both of which are on Flathub and much easier to set up (or at least GPT4All is; I haven’t tested Alpaca yet).
Alpaca is great, I can even run it on my oneplus 6t, albeit slowly and the max size I got running was llama 7b