Statistics for Less is More: Restricted Representations for Better Interpretability and Generalizability