The Holy See has lifted the diplomatic immunity of its representative in Paris under investigation for the alleged sexual abuse of at least four men, the French foreign ministry confirmed Monday.