Plus Olivander reckoned in book one that Voldemort did great things, terrible things, but great. Why would he add in the terrible clarification if he were on Voldemort's side? I mean, we've never seen Malfoy or people of his ilk do it. They would just say that Voldemort was doing the right thing in his quest for power and to purge the wizard world of non-pure bloods.