I have been exploring llama.cpp and wanted to ask people who have tried it in practice.
I am particularly interested in customisation and cost control. I would like to compare approaches that people have actually used rather than just theoretical suggestions.
Are there any settings, tools, or workflow changes that made a noticeable difference?
I am particularly interested in customisation and cost control. I would like to compare approaches that people have actually used rather than just theoretical suggestions.
Are there any settings, tools, or workflow changes that made a noticeable difference?