Apparently Spies can give you quests, including the one where they ask you to save their friends/family from a location. Now I have a follower that was brought here because a spy asked me to save him.