How do you improve testing when working with Large Language Models?

[holly_2fco]

I am trying to improve my approach to Large Language Models and could use some practical advice.

I am particularly interested in testing and prompt design. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What would you tell someone trying this for the first time?