performance: which workflow works best for Deep Learning?

[wildsarah]

I have a question about Deep Learning that may be useful for other people working with it too.

I am particularly interested in performance and best workflow. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What would you tell someone trying this for the first time?