I have been exploring llama.cpp and wanted to ask people who have tried it in practice.
I am particularly interested in cost control and learning curve. I would like to compare approaches that people have actually used rather than just theoretical suggestions.
What trade-offs have you found between quality, speed, cost, and reliability?
I am particularly interested in cost control and learning curve. I would like to compare approaches that people have actually used rather than just theoretical suggestions.
What trade-offs have you found between quality, speed, cost, and reliability?