Ruoyu Wang 王若愚
 |
PhD, advised by Prof. Jun Du. |
Interests
Multi-Array, Multi-Channel, Audio-visual Speech Signal Processing
Speaker Diarization, Speech Separation, Far-field, Multi-talker Speech Recognition
Generative AI, Sound Effects and Music Generation
SLM, LALM, Post-training Reinforcement Learning
Awards and Honors
1st of CHiME-9 MCoRec, May. 2026.
1st of multi-channel & single-channel tracks in CHiME-8 NOTSOFAR, Aug. 2024.
1st of main & sub tracks in CHiME-7 DASR, Aug. 2023.
1st of DCASE2023 Task5: few-shot bioacoustic event detection challenge, June. 2023
Outstanding intern of the year in iFlytek RDG Platform, Jan. 2022
1st of 15 constrained and 7 unconstrained tracks in low resource speech recognition challenge OpenASR21, Nov. 2021
2nd of synthetic speech detection challenge ASVspoof2021 LA task, Aug. 2021
Main Publications
Ya Jiang, Ruoyu Wang, Jingxuan Zhang, Jun Du, et al. “The USTC-NERCSLIP Systems for the CHiME-9 MCoRec Challenge.” CHiME-9 Workshop, 2026. (1st Place Technical Report)
Yi Han, Hang Chen, Ruoyu Wang, Jun Du, et al. “Hierarchical Contrastive Learning with Speech Language Model for Separating Similar Speakers.” ICASSP 2026.
Jiangyu Han, Ruoyu Wang, Yoshiki Masuyama, et al. “Spatially aware self-supervised models for multi-channel neural speaker diarization.” ICASSP 2026.
Ruoyu Wang, Jun Du, Shu-Tong Niu, et al. “Three-stage modular speaker diarization collaborating with front-end techniques in the CHiME-8 NOTSOFAR-1 challenge.” Computer Speech & Language, 2025.
Ruoyu Wang, Shutong Niu, et al. “Incorporating Spatial Cues in Modular Speaker Diarization for Multi-channel Multi-party Meetings.” ICASSP 2025.
Shutong Niu, Jun Du, Ruoyu Wang, Gao-Bin Yang, et al. “DCF-DS: Deep cascade fusion of diarization and separation for speech recognition under realistic single-channel conditions.” IEEE/ACM TASLP, 2025.
Chang Li*, Ruoyu Wang*, et al. “Quality-aware Masked Diffusion Transformer for Enhanced Music Generation.” IJCAI 2025.
Shutong Niu, Ruoyu Wang, Jun Du, et al. “The ustc-nercslip systems for the chime-8 notsofar-1 challenge.” CHiME-8 Workshop, 2024. (1st Place Technical Report)
Ruoyu Wang, Maokui He, Jun Du, et al. “The USTC-NERCSLIP Systems for the CHiME-7 DASR Challenge.” CHiME-7 Workshop, 2023. (1st Place Technical Report)
Ruoyu Wang, Jun Du, and Tian Gao. “Quantum Transfer Learning Using the Large-Scale Unsupervised Pre-Trained Model Wavlm-Large for Synthetic Speech Detection.” ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2023.
Ruoyu Wang, Jun Du, and Chang Wang. “Multi-branch Network with Circle Loss Using Voice Conversion and Channel Robust Data Augmentation for Synthetic Speech Detection.” Chinese Conference on Biometric Recognition. Cham: Springer Nature Switzerland, 2022.
Guolong Zhong, Hongyu Song, Ruoyu Wang, et al. “External Text Based Data Augmentation for Low-Resource Speech Recognition in the Constrained Condition of OpenASR21 Challenge.” Proc. Interspeech 2022 (2022): 4860-4864.
Education
PhD in Information and Communication Engineering for Data Science, University of Science and Technology of China, Sept. 2021 - present
B.S. in Mathematics, Department of Probability and Statistics, University of Science and Technology of China, Sept. 2017 - Jun. 2021