How do you improve customisation when working with Deep Learning?

[alfie_1b2q]

There are several ways to approach Deep Learning, so I wanted to compare experiences.

I am particularly interested in customisation and setup choices. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

Which approach would you recommend and why?