About the spectrum of permutation operators