Size Constraints in Segmentation and Size Predictions

dc.contributor.authorFan, Xingye
dc.date.accessioned2024-05-08T15:05:12Z
dc.date.available2024-05-08T15:05:12Z
dc.date.issued2024-05-08
dc.date.submitted2024-04-19
dc.description.abstractSegment size, which one may equivalently refer to as volume, area, or cardinality, is uniquely defined by segmentation, e.g. by aggregating pixel-level predictions. On the other hand, size provides only a very weak constraint on segmentation. However, as this thesis observes, explicit size constraints are powerful cues for training segmentation models in weakly supervised settings, e.g. when only image-level class tags are provided or a fraction of pixels is labeled. We also observe that some standard unsupervised losses may have implicit size bias resulting in notable segmentation artifacts. This thesis addresses three closely related problems regarding size constraints in segmentation and size predictions. First, we propose explicit size targets for training segmentation models without ground truth masks. We show approximate size targets predicted by human annotators result in segmentation quality on par with full pixel-precise supervision. The second contribution of this thesis is to show implicit size bias in standard unsupervised segmentation losses common in scribble supervision, e.g. mutual information or the Potts model. We show that this bias leads to the performance collapse as the amount of scribbles decreases. In contrast, our size-target supervision works well without any scribbles. Lastly, inspired by the enhanced segmentation outcomes achieved through size-target supervision, we explore the potential of deep models in predicting sizes directly.en
dc.identifier.urihttp://hdl.handle.net/10012/20543
dc.language.isoenen
dc.pendingfalse
dc.publisherUniversity of Waterlooen
dc.subjectdeep learningen
dc.subjectweak supervisionen
dc.subjectloss functionen
dc.titleSize Constraints in Segmentation and Size Predictionsen
dc.typeMaster Thesisen
uws-etd.degreeMaster of Mathematicsen
uws-etd.degree.departmentDavid R. Cheriton School of Computer Scienceen
uws-etd.degree.disciplineComputer Scienceen
uws-etd.degree.grantorUniversity of Waterlooen
uws-etd.embargo.terms0en
uws.contributor.advisorBoykov, Yuri
uws.contributor.affiliation1Faculty of Mathematicsen
uws.peerReviewStatusUnrevieweden
uws.published.cityWaterlooen
uws.published.countryCanadaen
uws.published.provinceOntarioen
uws.scholarLevelGraduateen
uws.typeOfResourceTexten

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Fan_Xingye.pdf
Size:
14.26 MB
Format:
Adobe Portable Document Format
Description:
Main article
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
6.4 KB
Format:
Item-specific license agreed upon to submission
Description: