deployment question: how do you handle Large Language Models?

[ella4864]

I have been exploring Large Language Models and wanted to ask people who have tried it in practice.

I am particularly interested in deployment and cost control. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What trade-offs have you found between quality, speed, cost, and reliability?