Statistics for Learning with non-Standard Supervision