• ChickenBooA
      link
      fedilink
      English
      arrow-up
      6
      ·
      edit-2
      1 year ago

      For the bigger ones you could do it under $.50 / hr. I run llama 2 13b-8 bit on my 3090 no problem, which can be rented for $.20/hr.

      https://vast.ai/#pricing

      Some of the lower pricing I’ve seen.

      • PeepinGoodArgs@reddthat.com
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        How do you get into doing this? Like, are you a data scientist? AI Engineer? Hobbyist?

        I want to be able to use tools like this, and I want a formal education in it, but I’m not sure what path to take. (I don’t necessarily want a career in it…my current career is pretty fantastic, but I think understanding tools like this is extremely important in understanding the modern world. That’s my main motivation.)