What is the best way to approach testing for AI Apps?

[connoroncodes]

There are several ways to approach AI Apps, so I wanted to compare experiences.

I am particularly interested in testing and setup choices. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

Are there any settings, tools, or workflow changes that made a noticeable difference?

 

[hannahwaves]

One thing worth trying with What is the best way to approach testing for AI Apps? is a controlled comparison around approach and testing. Use the same input for each test and note what changes in the output rather than judging from a single run. That way you can improve the workflow without losing track of what caused the improvement.

 

[olivermatrix]

For What is the best way to approach testing for AI Apps?, I would separate the problem into setup, output quality and repeatability. approach and testing fits into that because it can change the result quite a lot depending on the workflow. That way you can improve the workflow without losing track of what caused the improvement.