Disentangling the Spatial Structure and Style in Conditional VAE
share
This paper aims to disentangle the latent space in cVAE into the spatial structure and the style code, which are complementary to each other, with one of them z_s being label relevant and the other z_u irrelevant. The generator is built by a connected encoder-decoder and a label condition mapping network. Depending on whether the label is related with the spatial structure, the output z_s from the condition mapping network is used either as a style code or a spatial structure code. The encoder provides the label irrelevant posterior from which z_u is sampled. The decoder employs z_s and z_u in each layer by adaptive normalization like SPADE or AdaIN. Extensive experiments on two datasets with different types of labels show the effectiveness of our method.
READ FULL TEXT