
Ph.D. student at Utrecht University
Email: y [dot] du [at] uu [dot] nl
Address: BBG 5.05, 3584CC Utrecht, the Netherlands
Short Bio
I am a final-year Ph.D. student at Utrecht University, advised by Dr. Dong Nguyen. I am also currently visiting LMU Munich, working with Prof. Barbara Plank. I work on NLP and ML, and I am now interested in building steerable models of strong reasoning capabilities, particularly from a data-centric perspective.
Before joining UU, I received both my bachelor’s (Psychology, 2017) and my master’s (Computer Science, 2020, advised by Dr. Yuanbin Wu) degrees from East China Normal University.
I am on the job market! I am looking for postdoc positions in NLP/ML, starting from Summer/Fall 2025. Feel free to reach out if you have any opportunities or questions!
Selected Publications
-
Yupei Du, Albert Gatt, and Dong Nguyen.
FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics. COLING 2025. Previously DMLR Workshop @ ICLR 2024. [pdf]
TL;DR: We show that the training dynamics of an efficient but weak model can be transferred to much more capable models to achieve better robustness and efficiency. -
Goya van Boven, Yupei Du, and Dong Nguyen.
Transforming Dutch: Debiasing Dutch Coreference Resolution Systems for Non-binary Pronouns. FAccT 2024. [pdf]
TL;DR: We show that few-shot counterfactual data augmentation can effectively debias Dutch coreference resolution systems for non-binary pronouns. -
Yupei Du, Qi Zheng, Yuanbin Wu, Man Lan, Yan Yang, Meirong Ma.
Understanding Gender Bias in Knowledge Base Embeddings. ACL 2022. [pdf]
TL;DR: We propose methods to both quantify and trace the origins of gender biases in knowledge base (embeddings), using a closed-form approximation of influence functions. -
Yupei Du, Yuanbin Wu, Man Lan.
Exploring Human Gender Stereotypes with Word Association Test. EMNLP 2019. [pdf]
TL;DR: We use label propagation to quantify and visualize how gender biases are transferred and reinforced through word associations, and therefore offer a large-scale dataset of word-level gender bias scores.
Experience
-
Applied Scientist Intern at Amazon.com Inc., Berlin, Germany. Nov. 2022 – May 2023.
Mentored by Prof. Ziawasch Abedjan.
-
Research Intern at Sogou Inc., Hangzhou, China. Jul. 2019 – Jan. 2020.
Services
-
Program Committee (2021–): ACL, EMNLP, NAACL, EACL. (2024-): COLM
-
Outstanding Reviewer: ACL 2022.