Training Reject-Classifiers for Out-of-distribution Detection via Explicit Boundary Sample Generation
| dc.contributor.author | Vernekar, Sachin | |
| dc.date.accessioned | 2020-01-24T20:07:31Z | |
| dc.date.available | 2020-01-24T20:07:31Z | |
| dc.date.issued | 2020-01-24 | |
| dc.date.submitted | 2020-02-23 | |
| dc.description.abstract | Discriminatively trained neural classifiers can be trusted only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification errors. In the context of OOD detection for image classification, one of the recent approaches proposes training a classifier called “confident-classifier” by minimizing the standard cross-entropy loss on in-distribution samples and minimizing the KL divergence between the predictive distribution of OOD samples in the low-density “boundary” of in-distribution and the uniform distribution (maximizing the entropy of the outputs). Thus, the samples could be detected as OOD if they have low confidence or high entropy. In this work, we analyze this setting both theoretically and experimentally. We also propose a novel algorithm to generate the “boundary” OOD samples to train a classifier with an explicit “reject” class for OOD samples. We show that this approach is effective in reducing high-confident miss-predictions on OOD samples while maintaining the test-error and high-confidence on the in-distribution samples compared to standard training. We compare our approach against several recent classifier-based OOD detectors including the confident-classifiers on MNIST and FashionMNIST datasets. Overall the proposed approach consistently performs better than others across most of the experiments. | en |
| dc.identifier.uri | http://hdl.handle.net/10012/15582 | |
| dc.language.iso | en | en |
| dc.pending | false | |
| dc.publisher | University of Waterloo | en |
| dc.relation.uri | https://github.com/sverneka/ICLR2020 | en |
| dc.subject | Out-of-distribution detection | en |
| dc.subject | Reject-Classifier | en |
| dc.subject | Variational Autoencoder | en |
| dc.subject | Manifold | en |
| dc.subject.lcsh | Machine learning | en |
| dc.subject.lcsh | Neural networks (Computer science) | en |
| dc.title | Training Reject-Classifiers for Out-of-distribution Detection via Explicit Boundary Sample Generation | en |
| dc.type | Master Thesis | en |
| uws-etd.degree | Master of Mathematics | en |
| uws-etd.degree.department | David R. Cheriton School of Computer Science | en |
| uws-etd.degree.discipline | Computer Science | en |
| uws-etd.degree.grantor | University of Waterloo | en |
| uws.comment.hidden | The initial title was "A Classifi er-based Approach for Out-of-distribution Detection" and it was changed to "Training Reject-Classifiers for Out-of-distribution Detection via Explicit Boundary SampleGeneration" | en |
| uws.contributor.advisor | Czarnecki, Krzysztof | |
| uws.contributor.affiliation1 | Faculty of Mathematics | en |
| uws.peerReviewStatus | Unreviewed | en |
| uws.published.city | Waterloo | en |
| uws.published.country | Canada | en |
| uws.published.province | Ontario | en |
| uws.scholarLevel | Graduate | en |
| uws.typeOfResource | Text | en |