I have always thought that Fudge was more of a hanger on. Always following somebody. It could be that he is a death eater just like Barty Crouch Jr was. It would make sense. Yet at the same time I think he (Fudge) is to weak minded to really be a death eater. What about Fudge being under one of the unforgivable curses?