Rimu

This does seem tenuous, yes.

If they want to experiment with AI a bit and try to find a use-case for it, a bit of R&D every now and then can be good, right? But the way to do that would be to temporarily rent a VPS with a GPU. From AWS or whatever. That way when/if it looks good they’ll know roughly what size hardware to buy (way more than a 5070 ti most likely). Also if it doesn’t pan out all you’ve lost is a couple of hundred $ on one month’s rental and you can close it down and move on.

Or just use the OpenAI API, that way you don’t need to figure out how to run a model at all and can just concentrate on the data integration to see if that’s viable.