dc.contributor.author | Shahidi, Hamidreza | |
dc.date.accessioned | 2019-08-28 18:15:16 (GMT) | |
dc.date.available | 2019-12-27 05:50:06 (GMT) | |
dc.date.issued | 2019-08-28 | |
dc.date.submitted | 2019-08-23 | |
dc.identifier.uri | http://hdl.handle.net/10012/14979 | |
dc.description.abstract | A number of researchers have recently questioned the necessity of increasingly complex
neural network (NN) architectures. In particular, several recent papers have shown that simpler,
properly tuned models are at least competitive across several natural language processing
tasks. In this thesis, we show that this is also the case for text generation from structured and
unstructured data. Specifically, we consider neural table-to-text generation and neural question
generation (NQG) tasks for text generation from structured and unstructured data respectively.
Table-to-text generation aims to generate a description based on a given table, and NQG is the
task of generating a question from a given passage where the generated question can be answered
by a certain sub-span of the passage using NN models. Experiments demonstrate that a basic
attention-based sequence-to-sequence model trained with exponential moving average technique
achieves state of the art in both tasks. We further investigate using reinforcement learning with
different reward functions to refine our pre-trained model for both tasks. | en |
dc.language.iso | en | en |
dc.publisher | University of Waterloo | en |
dc.subject | deep learning | en |
dc.subject | reinforcement learning | en |
dc.subject | natural language processing | en |
dc.subject | text generation | en |
dc.title | Neural Text Generation from Structured and Unstructured Data | en |
dc.type | Master Thesis | en |
dc.pending | false | |
uws-etd.degree.department | David R. Cheriton School of Computer Science | en |
uws-etd.degree.discipline | Computer Science | en |
uws-etd.degree.grantor | University of Waterloo | en |
uws-etd.degree | Master of Mathematics | en |
uws-etd.embargo.terms | 4 months | en |
uws.contributor.advisor | Li, Ming | |
uws.contributor.advisor | Lin, Jimmy | |
uws.contributor.affiliation1 | Faculty of Mathematics | en |
uws.published.city | Waterloo | en |
uws.published.country | Canada | en |
uws.published.province | Ontario | en |
uws.typeOfResource | Text | en |
uws.peerReviewStatus | Unreviewed | en |
uws.scholarLevel | Graduate | en |