testing question: how do you handle Local LLMs?

[jay_2ax2]

There are several ways to approach Local LLMs, so I wanted to compare experiences.

I am particularly interested in testing and setup choices. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What would you tell someone trying this for the first time?