• ChickenBooA
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    1 year ago

    For the bigger ones you could do it under $.50 / hr. I run llama 2 13b-8 bit on my 3090 no problem, which can be rented for $.20/hr.

    https://vast.ai/#pricing

    Some of the lower pricing I’ve seen.

    • PeepinGoodArgs@reddthat.com
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      How do you get into doing this? Like, are you a data scientist? AI Engineer? Hobbyist?

      I want to be able to use tools like this, and I want a formal education in it, but I’m not sure what path to take. (I don’t necessarily want a career in it…my current career is pretty fantastic, but I think understanding tools like this is extremely important in understanding the modern world. That’s my main motivation.)