How do you improve testing when working with Natural Language Processing?

[rosiecra]

There are several ways to approach Natural Language Processing, so I wanted to compare experiences.

I am particularly interested in testing and useful tools. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

Are there any settings, tools, or workflow changes that made a noticeable difference?