Interesting, I gather that you think Olivander is in hiding as opposed to being abducted. That could explain the sudden disappearance and no sign of a struggle.

It makes for a better story and a potential advantage for Harry over Voldemort - I like it.