How do you improve performance when working with llama.cpp?

[lilyai96]

There are several ways to approach llama.cpp, so I wanted to compare experiences.

I am particularly interested in performance and future improvements. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What would you tell someone trying this for the first time?