How do you improve evaluation when working with llama.cpp?

[anna4815]

I have a question about llama.cpp that may be useful for other people working with it too.

I am particularly interested in evaluation and limitations. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What has worked best for you, and what would you avoid?