How do you improve customisation when working with llama.cpp?

[amelia4517]

I am trying to improve my approach to llama.cpp and could use some practical advice.

I am particularly interested in customisation and evaluation. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What trade-offs have you found between quality, speed, cost, and reliability?