ShengmingYin

Shengming Yin (殷晟明)

Google Scholar / Github

Shengming Yin is currently a master student in University of Science and Technology of China(USTC) , under the co-supervision of Prof. Nan Duan and Prof. Houqiang Li. He won the Guo Moruo Scholarship with the highest honors in USTC. He receive his B.S. degree in Electronic Information Engineering from USTC in 2023.

Research Experience

• [2024/9 ~ present] Research Intern, StepFun (Mentor: Chenfei Wu ).
• [2022/8 ~ 2024/9] Research Intern, Microsoft Research Asia (Mentor: Chenfei Wu ).

Publications

• DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory. (Homepage GitHub Demo)
  Shengming Yin, Chenfei Wu, Jian Liang, Jie Shi, Houqiang Li, Gong Ming, Nan Duan
  arXiv, 2023
• NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation. (Homepage)
  Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Gong Ming, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
  ACL, Oral, 2023
• Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models. (GitHub)
  Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, Nan Duan.
  arXiv, 2023.
• Learning 3D Photography Videos via Self-supervised Diffusion on Single Images.
  Xiaodong Wang, Chenfei Wu, Shengming Yin, Minheng Ni, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Fan Yang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan.
  IJCAI, 2023.
• ORES: Open-vocabulary Responsible Visual Synthesis.
  Minheng Ni, Chenfei Wu, Xiaodong Wang, Shengming Yin, Lijuan Wang, Zicheng Liu, Nan Duan
  AAAI, 2024
• Using Left and Right Brains Together: Towards Vision and Language Planning.
  Jun Cen, Chenfei Wu, Xiao Liu, Shengming Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang.
  ICML 2024 Poster.
• StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis.
  Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Shengming Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan.
  ICML 2024 Poster.
• EG4D: Explicit Generation of 4D Object without Score Distillation.
  Qi Sun, Zhiyang Guo, Ziyu Wan, Jing Nathan Yan, Shengming Yin, Wengang Zhou, Jing Liao, Houqiang Li
  ICLR 2025 Poster.

Selected Honors

• [2023] Guo Moruo Scholarship (郭沫若奖学金, The highest honor in USTC).
• [2023] Outstanding graduates of USTC.
• [2022] China National Scholarship (国家奖学金)
• [2021] China National Scholarship (国家奖学金)
• [2019] First Prize, Outstanding Student Scholarship of USTC