getting started question: how do you handle Datasets?

[tashavision29]

There are several ways to approach Datasets, so I wanted to compare experiences.

I am particularly interested in getting started and cost control. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

Which approach would you recommend and why?