privacy considerations: which workflow works best for llama.cpp?

[poppyjou]

I have been exploring llama.cpp and wanted to ask people who have tried it in practice.

I am particularly interested in privacy considerations and reliability. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What trade-offs have you found between quality, speed, cost, and reliability?