I don't think it's the end of the world. Weapons/armour don't seem to be what's key in this game.
But on that note, I just finished that quest before moving on to Act 2.
Well, after making sure that I couldn't get to the temple in Act 1.
I've gone up in the lift rather than over the mountain pass.