Thank you! Will look into this

They don’t have huge clients, just a steady flow. 3 locations due to small 5-7 person groups per office instead of one big office. Tbh idk why they do it like that lol

Kinda, kinda not? The lawyer who owns the firm really wants new Ai features and asks about stuff all the time, but he doesn’t necessarily have a specific goal, rather, just gives times to create automations with reports or whatever

That’s what I was thinking, they were saying that a 5070 Ti would be good enough for “whatever Ai automations the firm wants to build” which is where I was calling BS

That’s what I was thinking too, I’m pretty sure just using the API for those models or a VM with a GPU like you said would be the only viable options

I’m not an expert at all, I’ve never built out an enterprise system before so that’s why I wanted to verify.

I know you can run really small models on some 16gb VRAM cards, so I didn’t know if people use tiny models for very basic automation systems or something. I haven’t heard of that being viable but wanted to sanity check myself

The lawyer who owns the firm has me approve all tech vendors. I have not built out my personal homelab, know l some jargon and theory, but don’t have practical experience here.

Saw red flags and wanted to verify cause it’s part of my role