His muggle father left his pureblood mother. (unforgivable really)
Perhaps he thought that only muggles have this weakness of character - to run when something goes wrong.
Perhaps he thought that if his father had also been a pureblood - his parents would have stayed together.

I think this would have been the crucial childhood theory that would have driven Voldie throughout his muggle annihilation crusade.