What are the biggest mistakes with troubleshooting in Machine Learning?

[meganstudio]

I am trying to improve my approach to Machine Learning and could use some practical advice.

I am particularly interested in troubleshooting and security. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What has worked best for you, and what would you avoid?