Disentangling Timbre and Singing Style with Multi-singer Singing\n Synthesis System

In this study, we define the identity of the singer with two independent\nconcepts - timbre and singing style - and propose a multi-singer singing\nsynthesis system that can model them separately. To this end, we extend our\nsingle-singer model into a multi-singer model in the following ways: first, we\ndesign a singer identity encoder that can adequately reflect the identity of a\nsinger. Second, we use encoded singer identity to condition the two independent\ndecoders that model timbre and singing style, respectively. Through a user\nstudy with the listening tests, we experimentally verify that the proposed\nframework is capable of generating a natural singing voice of high quality\nwhile independently controlling the timbre and singing style. Also, by using\nthe method of changing singing styles while fixing the timbre, we suggest that\nour proposed network can produce a more expressive singing voice.\n