back

^* indicates equal contribution ⁺ indicates corresponding author

Recent Preprint

• Scaling Laws for Predicting Downstream Performance in LLMs [paper]
  Yangyi Chen, Binxuan Huang, Yifan Gao, Zhengyang Wang, Jingfeng Yang, Heng Ji
  

Conference & Journal Paper

2024

• A Single Transformer for Scalable Vision-Language Modeling [paper]
  Yangyi Chen^*, Xingyao Wang^*, Hao Peng, Heng Ji
  TMLR

• SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales [paper]
  Tianyang Xu^*, Shujin Wu^*, Shizhe Diao, Xiaoze Liu, Xingyao Wang, Yangyi Chen⁺, Jing Gao⁺
  EMNLP

• Executable Code Actions Elicit Better LLM Agents [paper]
  Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji
  ICML

• Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models [paper]
  Yangyi Chen, Karan Sikka, Michael Cogswell, Heng Ji, Ajay Divakaran.
  NAACL

• R-Tuning: Instructing Large Language Models to Say `I Don’t Know’ [paper]
  Hanning Zhang^*, Shizhe Diao^*, Yong Lin^*, Yi R. Fung, Qing Lian, Xingyao Wang, Yangyi Chen, Heng Ji, Tong Zhang.
  NAACL (Oral & Outstanding Paper Award)

• DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback [paper]
  Yangyi Chen, Karan Sikka, Michael Cogswell, Heng Ji, Ajay Divakaran
  CVPR

• MINT: Evaluating LLMs in Multi-Turn Interaction with Tools and Language Feedback [paper]
  Xingyao Wang^*, Zihan Wang^*, Jiateng Liu, Yangyi Chen, Lifan Yuan, Hao Peng, Heng Ji.
  ICLR

• CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets [paper]
  Lifan Yuan^*, Yangyi Chen^*, Xingyao Wang, Yi R. Fung, Hao Peng, Heng Ji.
  ICLR

2023

• ViStruct: Visual Structural Knowledge Extraction via Curriculum Guided Code-Vision Representation [paper]
  Yangyi Chen, Xingyao Wang, Manling Li, Derek Hoiem, Heng Ji.
  EMNLP (Oral)

• Beat LLMs at Their Own Game: Zero-Shot LLM-Generated Text Detection via Querying ChatGPT [paper]
  Biru Zhu, Lifan Yuan, Ganqu Cui, Yangyi Chen, Chong Fu, Bingxiang He, Yangdong Deng, Zhiyuan Liu, Maosong Sun, Ming Gu.
  EMNLP (Short)

• Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations [paper]
  Lifan Yuan, Yangyi Chen, Ganqu Cui, Hongcheng Gao, Fangyuan Zou, Xingyi Cheng, Heng Ji, Zhiyuan Liu, Maosong Sun.
  NeurIPS (Dataset and Benchmark Track)

• Removing Backdoors in Pre-trained Models by Regularized Continual Pre-training [paper]
  Biru Zhu^*, Ganqu Cui^*, Yangyi Chen, Yujia Qin, Lifan Yuan, Chong Fu, Yangdong Deng, Zhiyuan Liu, Maosong Sun, Ming Gu.
  TACL

• A Close Look into the Calibration of Pre-trained Language Models [paper]
  Yangyi Chen^*, Lifan Yuan^*, Ganqu Cui, Zhiyuan Liu, Heng Ji.
  ACL

• From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework [paper]
  Yangyi Chen^*, Hongcheng Gao^*, Ganqu Cui^*, Lifan Yuan, Dehan Kong, Hanlu Wu, Ning Shi, Bo Yuan, Longtao Huang, hui xue, Zhiyuan Liu, Maosong Sun, Heng Ji.
  ACL (Findings)

• Bridge the Gap Between CV and NLP! A Gradient-based Textual Adversarial Attack Framework [paper]
  Lifan Yuan^*, Yichi Zhang^*, Yangyi Chen, Wei Wei.
  ACL (Findings)

2022

• Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP [paper]
  Yangyi Chen^*, Hongcheng Gao^*, Ganqu Cui, Fanchao Qi, Longtao Huang, Zhiyuan Liu, Maosong Sun.
  EMNLP

• Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks [paper]
  Yangyi Chen^*, Fanchao Qi^*, Hongcheng Gao, Zhiyuan Liu, Maosong Sun.
  EMNLP (Short)

• Moderate-fitting as a Natural Backdoor Defender for Pre-trained Language Models [paper]
  Biru Zhu^*, Yujia Qin^*, Ganqu Cui, Yangyi Chen, Weilin Zhao, Chong Fu, Yangdong Deng, Zhiyuan Liu, Jingang Wang, Wei Wu, Maosong Sun, Ming Gu.
  NeurIPS

• A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks [paper]
  Ganqu Cui^*, Lifan Yuan^*, Bingxiang He, Yangyi Chen, Zhiyuan Liu, Maosong Sun.
  NeurIPS (Dataset and Benchmark Track) (Spotlight)

• Exploring the Universal Vulnerability of Prompt-based Learning Paradigm [paper]
  Lei Xu, Yangyi Chen, Ganqu Cui, Hongcheng Gao, Zhiyuan Liu.
  NAACL (Findings)
  

2021

• Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer [paper]
  Fanchao Qi^*, Yangyi Chen^*, Xurui Zhang, Mukai Li, Zhiyuan Liu, Maosong Sun.
  EMNLP (Oral)

• Multi-granularity Textual Adversarial Attack with Behavior Cloning [paper]
  Yangyi Chen^*, Jin Su^*, Wei Wei.
  EMNLP (Oral)

• ONION: A Simple and Effective Defense Against Textual Backdoor Attacks [paper]
  Fanchao Qi^*, Yangyi Chen^*, Mukai Li, Zhiyuan Liu, Maosong Sun.
  EMNLP (Short & Oral)

• Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger [paper]
  Fanchao Qi^*, Mukai Li^*, Yangyi Chen^*, Zhengyan Zhang, Zhiyuan Liu, Yasheng Wang, Maosong Sun.
  ACL (Oral)

• Automatic Construction of Sememe Knowledge Bases via Dictionaries [paper]
  Fanchao Qi, Yangyi Chen, Fengyu Wang, Zhiyuan Liu, Xiao Chen, Maosong Sun.
  ACL (Findings)