Wasserstein Autoencoders with Mixture of Gaussian Priors for Stylized Text Generation
Loading...
Date
2021-01-28
Authors
Ghabussi, Amirpasha
Journal Title
Journal ISSN
Volume Title
Publisher
University of Waterloo
Abstract
Probabilistic text generation is an important application of Natural Language Processing (NLP). Variational autoencoders and Wasserstein autoencoders are two widely used methods for text generation. New research efforts focus on improving the quality of the generated samples for these two methods. While Wasserstein autoencoders are effective for text generation, they are unable to control the topic of generated text, even when the training dataset has samples from multiple categories with different styles. We present a semi-supervised approach using Wasserstein autoencoders and a mixture of Gaussian priors for topic-aware sentence generation. Our model is trained on a multi-class dataset and generates sentences in the style/topic of a desired class. It is also capable of interpolating multiple classes. Moreover, we can train our model on relatively small datasets. While a regular WAE or VAE cannot generate diverse sentences with few training samples, our approach generates diverse sentences and preserves the style and the content of the desired classes.
Description
Keywords
wasserstein autoencoders, mixture of gaussian, stylized text generation, generative models, text generation
LC Keywords
Natural language generation (Computer science)