future improvements question: how do you handle llama.cpp?

[theo4679]

I have been exploring llama.cpp and wanted to ask people who have tried it in practice.

I am particularly interested in future improvements and common mistakes. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What has worked best for you, and what would you avoid?