I think that when she was growing up she had no idea who Voldermort was, but once she got to the Wizarding World, found out who he is and what he did, she then became scared of him. Just my thoughts though.