• Ranta@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    5 months ago

    Style TTs2 for output. Localllama with a high quant on 4x 4090’. Personal AI assistant running on your local homelab for <30k.

    I kinda see it as a home appliance or vehicle level purchase.

    • keepthepace@slrpnk.net
      link
      fedilink
      arrow-up
      1
      ·
      5 months ago

      I am pretty sure that there are ASIC being put in production as we speak with Whisper embeded. Expect a 4 dollars chip to add voice recognition and a basic LLM to any appliance.