I personally always use a primer. As most have already mentioned, given the nature of paint, a primer will not only prevent the paint from peeling off (well, not always, but in most cases) but it will also add "depth" and "life" to your figure.
Depending on the primer's colour, it can also be helpful for later layers of paint (check the painting sessions for Model Cellar's Coal Miner).