I’m looking at starting a service that involves hosting a lot of LLM models, which are often going to be 16GB+ (compressed). I did a bit of searching for cloud storage providers with cheap egress, and the cheapest I could find is $0.01 per GB, which would still be $0.16+ per download.

How do sites like Huggingface or CivitAI do it? Lots of VC funding?

  • jeff 👨‍💻@programming.dev
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    1 year ago

    Lots of VC funding?

    Probably. They might have gotten additional discounts off of the advertized price by talking with sales and committing to the service for a year or other ways.

    • omegastick@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Interesting, I’ll have to have a look at doing something like that. If I remember correctly, the CivitAI devs are active on Discord, so maybe I could just ask them directly.

      • jeff 👨‍💻@programming.dev
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        There’s no harm in messaging the sales team directly. Whatever deals CivitAI got might not work for you, they might not even be legally allowed to mention specifics. But you can shop around and see what different providers will offer you.