voldemort can touch harry becaus of harry's blood. the reason why the curse backfired is because lily sacrificed her life for harry a.k.a. "old magic". if u can touch someone then there's bloody very well chance u can kill them. and they both know the killing curse.