avatar

Guanhua CHEN

Tenure-track Assistant Professor in SUSTech

Biography

Here is Guanhua Chen (陈冠华). I am an assistant professor in the Department of Statistics and Data Science in Southern University of Science and Technology (SUSTech). I received Ph.D. from the Department of Computer Science, The University of Hong Kong in 2022, under the supervision of Prof. Jia Pan and Prof. Wenping Wang. I obtained the Bachelor and Master degree from Tsinghua University in 2012 and 2014, respectively. I was a research intern in Microsoft Research Asia and Huawei Noah’s Ark Lab. Currently, I am an area chair of ACL, EMNLP and CCL, also the reviewer for top AI conferences and journal like ICML, NeurIPS, ICLR, ACL, EMNLP, NAACL, and TASLP. My research interests are natural language processing (NLP) and applied machine learning, such as data synthesis with large language model, multimodal LLMs, and complex reasoning with LLMs, etc.


Positions available: I am looking for self-motivated PostDoc/PhD/Master/visiting students to join our lab. If you are interested, please send me an email with your CV and transcripts. For your reference, here are the latest information of the PhD and Master application process of this year. Currently, we have 16 RTX 4090 GPUs (24GB), 16 NVIDIA L40 GPUs (48GB), and 4 A100 GPUs (40GB) available for students.

Publications

（* denotes corresponding author）

  • ImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMs
    • Yan Yang, Yixia Li, Hongru Wang, Xuetao Wei, James Jianqiao Yu, Yun Chen, Guanhua Chen*.
    • In Proceedings of ACL 2025 (CCF A, long paper in main conference)

  • FANNO: Augmenting High-Quality Instruction Data with Open-Sourced LLMs Only

    • He Zhu, Tianle Lun, Junyou Su, Yicheng Tao, Wenjia Zhang, Yun Chen, Guanhua Chen*. [arxiv]
    • In Findings of ACL 2025 (long paper)

  • Tag-Instruct: Controlled Instruction Complexity Enhancement through Structure-based Augmentation

    • He Zhu, Zhiwen Ruan, Junyou Su, Xingwei He, Wenjia Zhang, Yun Chen, Guanhua Chen*.
    • In Findings of ACL 2025 (long paper)

  • MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

    • Hanqing Wang, Yixia Li, Shuo Wang, Guanhua Chen*, Yun Chen*.
    • In Proceedings of NAACL 2025 (CCF B, long paper in main conference) [pdf] [code]

  • SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters

    • Yan Yang, Zeguan Xiao, Xin Lu, Hongru Wang, Xuetao Wei, Hailiang Huang, Guanhua Chen*, Yun Chen*.
    • In Proceedings of NAACL 2025 (CCF B, long paper in main conference) [pdf] [code]

  • Self-DC: When to Reason and When to Act? Self Divide-and-Conquer for Compositional Unknown Questions

    • Hongru Wang, Boyang Xue, Baohang Zhou, Tianhua Zhang, Cunxiang Wang, Huimin Wang, Guanhua Chen*, Kam-Fai Wong*
    • In Proceedings of NAACL 2025 (CCF B, long paper in main conference) [pdf]

  • LayAlign: Enhancing Multilingual Reasoning in LLMs via Layer-Wise Adaptive Fusion and Alignment Strategy

    • Zhiwen Ruan, Yixia Li, He Zhu, Longyue Wang, Weihua Luo, Kaifu Zhang, Yun Chen, Guanhua Chen*.
    • In Findings of NAACL 2025 (long paper) [pdf] [code]

  • SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation

    • Yixia Li, Boya Xiong, Guanhua Chen*, Yun Chen*
    • In Proceedings of NeurIPS 2024 (CCF A, long paper) [pdf] [code]

  • Distract Large Language Models for Automatic Jailbreak Attack

    • Zeguan Xiao, Yan Yang, Guanhua Chen*, Yun Chen*
    • In Proceedings of EMNLP 2024 (CCF B, long paper in main conference) [pdf]

  • PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning

    • Tianci Xue, Ziqi Wang, Yixia Li, Yun Chen, Guanhua Chen*
    • In Findings of ACL 2024 (long paper) [pdf] [code]

  • mCLIP: Multilingual CLIP via Cross-lingual Transfer

    • Guanhua Chen, Lu Hou, Yun Chen, Wenliang Dai, Lifeng Shang, Xin Jiang, Qun Liu, Jia Pan, Wenping Wang
    • In Proceedings of ACL 2023 (CCF A, long paper in main conference, oral) [pdf] [code]

  • XLM-D: Decorate Cross-lingual Pre-training Model as Non-Autoregressive Neural Machine Translation

    • Yong Wang, Shilin He, Guanhua Chen*, Yun Chen, Daxin Jiang*.
    • In Proceedings of EMNLP 2022 (CCF B, long paper in main conference) [pdf]

  • Multilingual Sentence Transformer as A Multilingual Word Aligner

    • Weikang Wang†, Guanhua Chen†, Hanqing Wang, Yue Han, Yun Chen.
    • In Findings of EMNLP 2022 (CCF B, short paper) [pdf] [code]

  • Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation

    • Guanhua Chen, Shuming Ma, Yun Chen, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei
    • In Proceedings of ACL 2022 (CCF A, long paper in main conference) [pdf] [code]

  • Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders

    • Guanhua Chen, Shuming Ma, Yun Chen, Li Dong, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei
    • In Proceedings of EMNLP 2021 (CCF B, long paper in main conference, oral) [pdf] [code]

  • Lexically Constrained Neural Machine Translation with Explicit Alignment Guidance

    • Guanhua Chen, Yun Chen, Victor O.K. Li
    • In Proceedings of AAAI 2021 (CCF A, long paper) [pdf] [code]

  • Lexical-Constraint-Aware Neural Machine Translation via Data Augmentation

    • Guanhua Chen, Yun Chen, Yong Wang, Victor O.K. Li
    • In Proceedings of IJCAI 2020 (CCF A, long paper) [pdf] [code]

  • Understanding Particles from Video: Property Estimation of Granular Materials via Visuo-Haptic Learning

    • Zeqing Zhang, Guangze Zheng, Xuebo Ji, Guanqi Chen, Ruixing Jia, Wentao Chen, Guanhua Chen, Liangjun Zhang, Jia Pan
    • IEEE Robotics and Automation Letters (2025). [paper]

  • StyleBART: Decorate Pretrained Model with Style Adapters for Unsupervised Stylistic Headline Generation

    • Hanqing Wang, Yajing Luo, Boya Xiong, Guanhua Chen, Yun Chen
    • In Findings of EMNLP 2023 (long paper) [pdf] [code]

  • Evaluating Explanation Methods for Vision-and-Language Navigation

    • Guanqi Chen, Lei Yang, Guanhua Chen, Jia Pan
    • In Proceedings of ECAI 2023 (CCF B, long paper in main conference) [pdf]

  • Accurate Word Alignment Induction from Neural Machine Translation

    • Yun Chen, Yang Liu, Guanhua Chen, Xin Jiang, Qun Liu
    • In Proceedings of EMNLP 2020 (CCF B, long paper in main conference, oral) [pdf] [code]

Working Papers

  • CompoundQA: A Benchmark for Evaluating LLMs on Compound Questions

    • Yutao Hou, Yajing Luo, Zhiwen Ruan, Hongru Wang, Weifeng Ge, Yun Chen, Guanhua Chen*. [arxiv]

  • Enhanced LLM-As-A-Judge with Layer-Wise Logits Aggregation

    • Peng Lai, Jianjie Zheng, Sijie Cheng, Yun Chen, Guanhua Chen*.

  • Unveiling Over-Memorization in Large Language Model Finetuning

    • Zhiwen Ruan, Yun Chen, Yutao Hou, Guanhua Chen*.

  • FigirPro: Enhancing Text-to-SQL with Fine-Grained Guidance from Pivot Programming Languages

    • Yongdong Chi, Hanqing Wang, Yun Chen, Yan Yang, Zonghan Yang, Xiao Yan, Guanhua Chen*.

  • ADAMIX: Adaptive Mixed-Precision Delta-Compression with Quantization Error Optimization for LLMs

    • Boya Xiong, Shuo Wang, Weifeng Ge, Yun Chen, Guanhua Chen*.

Teaching

  • STA323: Big Data Analysis Software and Application (Hadoop or Spark)
  • STA5007: Advanced Natural Language Processing

Group Members

  • PhD candidates: Zhiwen Ruan(2024), Yixia Li(2023)
  • Master students: Qi Wang(2025), Youxin Zhu(2025), Peng Lai(2024), Xiaodong Lao(2024), Jianjie Zheng(2024), Yongjie Wang(2023)

(Last updated on May. 2, 2025)