NLG

[Update 2022 Dec. 4] Added contrastive learning / decoding methods. Intro The task of generating content from deep learning (statistical) models is pretty different from other common machine learning tasks. The underlying objective is to train a model so it can generate realistic content during inference. For continuous domains, state of the art models are mostly based on adversarial (Generative Adversarial Networks, GANs) and denoising diffusion training objectives. These models are capable to create impressive and highly realistic results in a wide variety of styles....