I can see what you're getting at, but maybe he wasn't looking on that part of the map, but just on the part nearest to Hagrid's. I mean, the map is big and the names next to the people are minuscule.