reliability: which workflow works best for Deep Learning?

[logic_poppy]

I have a question about Deep Learning that may be useful for other people working with it too.

I am particularly interested in reliability and troubleshooting. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What would you tell someone trying this for the first time?