"What?" she asked incredulously. "You're a pirate, right? Don't you already take living people's stuff?"

Well, some people had their little lines they didn't want to cross. Maybe he was some history buff and considered messing with the present acceptable but taking relics a necessary evil, or something. People were weird like that.