How do you improve performance when working with Deep Learning?

[lucia5391]

I have been exploring Deep Learning and wanted to ask people who have tried it in practice.

I am particularly interested in performance and reliability. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What trade-offs have you found between quality, speed, cost, and reliability?