Statistics for Spectral, information-theoretic, and perturbative methods for quantum learning and error mitigation