Wow. I too always thought she was referring James.... I'm quite astonished that I've never noticed it before, but now looking back, it was so clear! JKR even implied the Snape/Lily story by making Harry say, "If you mean my mum and dad, why don't you use their names?" And I just assumed it was James whom Petunia was referring to!