avatar

Longguang Zhong

M.S. Student and Co-Founder of FuseAI
Sun Yat-sen University (SYSU)
zhonglg5@mail2.sysu.edu.cn


About Me

Hello, I’m Longguang Zhong, an M.S. student in Computer Technology at Sun Yat-sen University, where I’m currently studying under the supervision of Prof. Xiaojun Quan. I earned my bachelor’s degree in Software Engineering from Xidian University.

Research Interests

My research focuses on large language models, including pruning, model fusion, and preference alignment.

News

[Mar 2025] 🔥🔥 FuseChat-3.0 is accepted to ICLR 2025 Workshop!

[Jan 2025] 🔥🔥 We release FuseO1-Preview, an advanced fusion model that enhances System-II reasoning by integrating multiple O1-like models using SCE merging, excelling in mathematics, coding, and science.

[Dec 2024] 🔥 We release FuseChat-3.0 and Blog Post. FuseChat-3.0 contains a series of models crafted to enhance performance by integrating the strengths of multiple source LLMs into more compact target LLMs.

[Aug 2024] 🔥 We update the FuseChat tech report and release FuseChat-7B-v2.0, which is the fusion of six prominent chat LLMs with diverse architectures and scales. FuseChat-7B-v2.0 achieves an average performance of 7.38 on MT-Bench (GPT-4-0125-Preview as judge LLM), which is comparable to Mixtral-8x7B-Instruct and approaches GPT-3.5-Turbo-1106.

Publications

  1. BlockPruner: Fine-grained Pruning for Large Language Models
    Longguang Zhong, Fanqi Wan, Ruijun Chen, Xiaojun Quan*, Liangzhi Li (*Corresponding authors)
    PDF Code Tech Report

  2. FUSECHAT: Knowledge Fusion of Chat Models
    Fanqi Wan, Longguang Zhong, Ziyi Yang, Ruijun Chen, Xiaojun Quan* (*Corresponding authors)
    PDF Code Tech Report

  3. ICLR
    WEIGHTED-REWARD PREFERENCE OPTIMIZATION FOR IMPLICIT MODEL FUSION
    Ziyi Yang, Fanqi Wan, Longguang Zhong, Tianyuan Shi, Xiaojun Quan* (*Corresponding authors)
    The Thirteenth International Conference on Learning Representations (ICLR), 2025.
    PDF Code BibTex Poster

  4. ICLR Workshop
    FuseChat-3.0: Preference Optimization Meets Heterogeneous Model Fusion
    Ziyi Yang, Fanqi Wan, Longguang Zhong, Canbin Huang, Guosheng Liang, Xiaojun Quan* (*Corresponding authors)
    ICLR 2025 First Workshop on Open Science for Foundation Models (ICLR WorkShop), 2025.
    PDF Code BibTex Poster

Services

…