After the scene with Walter and Paige and Sly walking through the forest, and then another aerial shot that showed that the island was really a pretty decent size - with LOTS of trees - I just couldn't understand that Toby and Happy - or Walter and Paige, for that matter - couldn't sneak off at some point and get themselves lost for an hour or so.
Of course - maybe they were worried that they really would get lost. Or eaten.
