S²Voice

Style-Aware Autoregressive Modeling with Enhanced Conditioning for Singing Style Conversion

Ziqian Wang1, Xianjun Xia2, Chuanzeng Huang2, Lei Xie1*
1 Audio, Speech and Language Processing Group (ASLP@NPU), School of Software, Northwestern Polytechnical University, Xi'an, China
2 Bytedance, China
* Corresponding author

Abstract

We present S²Voice, the winning system of the Singing Voice Conversion Challenge (SVCC) 2025 for both the in-domain and zero-shot singing style conversion tracks. Built on the strong two-stage Vevo baseline, S²Voice advances style control and robustness through several contributions. First, we integrate style embeddings into the autoregressive large language model (AR LLM) via a FiLM-style layer-norm conditioning and a style-aware cross-attention for enhanced fine-grained style modeling. Second, we introduce a global speaker embedding into the flow-matching transformer to improve timbre similarity. Third, we curate a large, high-quality singing corpus via an automated pipeline for web harvesting, vocal separation, and transcript refinement. Finally, we employ a multi-stage training strategy combining supervised fine-tuning (SFT) and direct preference optimization (DPO). Subjective listening tests confirm our system's superior performance: leading in style similarity and singer similarity for Task 1, and across naturalness, style similarity, and singer similarity for Task 2. Ablation studies demonstrate the effectiveness of our contributions in enhancing style fidelity, timbre preservation, and generalization.

Singing Style Conversion Demo

Task 1: In-domain Singing Style Conversion (SSC)

Sample 1

Source:
Source Style: Breathy
0:00/0:08
System Target: Glissando Target: Pharyngeal Target: Vibrato
Reference Style
0:00/0:07
0:00/0:07
0:00/0:07
Vevo (Baseline)
0:00/0:08
0:00/0:08
0:00/0:08
S²Voice (Ours)
0:00/0:08
0:00/0:08
0:00/0:08

Sample 2

Source:
Source Style: Falsetto
0:00/0:09
System Target: Glissando Target: Pharyngeal Target: Vibrato
Reference Style
0:00/0:08
0:00/0:08
0:00/0:08
Vevo (Baseline)
0:00/0:09
0:00/0:09
0:00/0:09
S²Voice (Ours)
0:00/0:09
0:00/0:09
0:00/0:09

Task 2: Zero-shot Singing Style Conversion (SSC)

Sample 1

Source:
Source Style: Breathy
0:00/0:10
System Target: Glissando Target: Pharyngeal Target: Vibrato
Reference Style
0:00/0:09
0:00/0:09
0:00/0:09
Vevo (Baseline)
0:00/0:10
0:00/0:10
0:00/0:10
S²Voice (Ours)
0:00/0:10
0:00/0:10
0:00/0:10

Sample 2

Source:
Source Style: Falsetto
0:00/0:08
System Target: Glissando Target: Pharyngeal Target: Vibrato
Reference Style
0:00/0:07
0:00/0:07
0:00/0:07
Vevo (Baseline)
0:00/0:08
0:00/0:08
0:00/0:08
S²Voice (Ours)
0:00/0:08
0:00/0:08
0:00/0:08