You don't have to worry about that. When you come here, your world is momentarily frozen in time. When you return, it's at the exact second you left, so it's as if you never really left.