According to the book, if you go back in time, everything is the same as it was then. The only thing that will throw a monkey wrench into the works is being seen when you go back. Did Book 3 mention what the consequences of being seen are?
I cannot remember.