Xin Yin
2026
RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository
Zhiyuan Peng | Xin Yin | Pu Zhao | Fangkai Yang | Lu Wang | Ran Jia | Xu Chen | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhiyuan Peng | Xin Yin | Pu Zhao | Fangkai Yang | Lu Wang | Ran Jia | Xu Chen | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models and agents have achieved remarkable progress in code generation. However, existing benchmarks focus on isolated function/class-level generation (e.g., ClassEval) or modifications to existing codebases (e.g., SWE-Bench), neglecting complete microservice repository generation that reflects real-world 0-to-1 development workflows. To bridge this gap, we introduce RepoGenesis, the first multilingual benchmark for repository-level end-to-end web microservice generation, comprising 106 repositories (60 Python, 46 Java) across 18 domains and 11 frameworks, with 1,258 API endpoints and 2,335 test cases verified through a “review-rebuttal” quality assurance process. We evaluate open-source agents (e.g., DeepCode) and commercial IDEs (e.g., Cursor) using Pass@1, API Coverage (AC), and Deployment Success Rate (DSR). Results reveal that despite high AC (up to 73.91%) and DSR (up to 100%), the best-performing system achieves only 23.67% Pass@1 on Python and 21.45% on Java, exposing deficiencies in architectural coherence, dependency management, and cross-file consistency. Notably, RepoGenesis-8B, fine-tuned on RepoGenesis (train), achieves performance comparable to GPT-5 mini, demonstrating the quality of RepoGenesis for advancing microservice generation. We release our benchmark at https://github.com/pzy2000/RepoGenesis.
RepoDistill: Distilling Repository Knowledge through Compression-Aware Budget Allocation and Policy Optimization
Xin Yin | Zixiang Ding | Yiang Zhang | Qiang Wang | Rui Wang | Chao Ni | Zhe Cui
Findings of the Association for Computational Linguistics: ACL 2026
Xin Yin | Zixiang Ding | Yiang Zhang | Qiang Wang | Rui Wang | Chao Ni | Zhe Cui
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models (LLMs) have achieved strong performance on many code-related tasks, yet they still struggle with repository-level scenarios where reasoning depends on long, noisy, and structurally complex contexts. While existing retrieval methods, including both similarity-based and graph-based approaches, can identify relevant code snippets, they often retrieve excessive contexts that intensify the "lost-in-the-middle" phenomenon and dilute model attention with redundant contexts. To address this, we present RepoDistill, a novel framework that integrates retrieval with learned budget allocation for fine-grained context compression. RepoDistill first employs a plug-and-play lightweight GraphRAG to retrieve context that follows logical flows. It then applies Compression-Aware Budget Allocation guided by Compression-Aware Policy Optimization, which formulates context management as a multi-step decision problem and learns allocation policies for contexts. Experiments show that RepoDistill outperforms baselines, achieving gains of up to +7.00 on SWE-QA, +24.4% on CoderEval, and +0.25 on LongCodeU. Furthermore, a compact 4B-parameter model trained with RepoDistill can serve as an effective context compressor for closed-source LLMs, reducing input tokens by up to 66% while maintaining comparable performance. We release our code at https://anonymous.4open.science/r/RepoDistill-12B0.
Tree-CoT-RT: An Explainable Multi-Path Tree-Guided Chain-of-Thought and Reinforcement Learning Framework for Aspect Sentiment Quad Prediction
Hao Zhang | Jiahao Wang | Zhenke Duan | Xin Yin | Haichuan Hu | Hualong Chen | Suyi | Congqing He | Yike Tan | Yu-N Cheah
Findings of the Association for Computational Linguistics: ACL 2026
Hao Zhang | Jiahao Wang | Zhenke Duan | Xin Yin | Haichuan Hu | Hualong Chen | Suyi | Congqing He | Yike Tan | Yu-N Cheah
Findings of the Association for Computational Linguistics: ACL 2026
Aspect Sentiment Quad Prediction (ASQP) is a fundamental yet challenging task in fine-grained sentiment analysis, particularly when aspects or opinions are implicit. Existing methods often lack explainability and generalization, making it difficult to justify inference decisions and to detect implicit sentiment across domains and varied expression patterns. To address these limitations, we propose Tree-CoT-RT, an explainable multi-path tree-guided chain-of-thought and reinforcement learning framework specifically designed for ASQP. The core idea is to use sentiment tree structures to design type-specific reasoning templates that guide LLMs in generating explainable chains, including both final sentiment quadruples and intermediate inference steps for transparent implicit reasoning. However, the generated reasoning chains often vary in quality and may contain logical inconsistencies. To mitigate this, we introduce a reinforcement learning strategy with a rule-based reward function to generate high-quality reasoning traces, which are then used to fine-tune the LLM and enable controlled sampling. Experiments on benchmark datasets demonstrate that Tree-CoT-RT substantially outperforms strong baselines, particularly in scenarios involving implicit sentiment analysis.
2025
SolEval: Benchmarking Large Language Models for Repository-level Solidity Smart Contract Generation
Zhiyuan Peng | Xin Yin | Rui Qian | Peiqin Lin | YongKang Liu | Hao Zhang | Chenhao Ying | Yuan Luo
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Zhiyuan Peng | Xin Yin | Rui Qian | Peiqin Lin | YongKang Liu | Hao Zhang | Chenhao Ying | Yuan Luo
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have transformed code generation.However, most existing approaches focus on mainstream languages such as Python and Java, neglecting the Solidity language, the predominant programming language for Ethereum smart contracts.Due to the lack of adequate benchmarks for Solidity, LLMs’ ability to generate secure, cost-effective smart contracts remains unexplored.To fill this gap, we construct SolEval, the first repository-level benchmark designed for Solidity smart contract generation, to evaluate the performance of LLMs on Solidity.SolEval consists of 1,507 samples from 28 different repositories, covering 6 popular domains, providing LLMs with a comprehensive evaluation benchmark.Unlike the existing Solidity benchmark, SolEval not only includes complex function calls but also reflects the real-world complexity of the Ethereum ecosystem by incorporating Gas@k and Vul@k.We evaluate 16 LLMs on SolEval, and our results show that the best-performing LLM achieves only 26.29% Pass@10, highlighting substantial room for improvement in Solidity code generation by LLMs.Additionally, we conduct supervised fine-tuning (SFT) on Qwen-7B using SolEval, resulting in a significant performance improvement, with Pass@5 increasing from 16.67% to 58.33%, demonstrating the effectiveness of fine-tuning LLMs on our benchmark.We release our data and code at https://github.com/pzy2000/SolEval.
Pre-training CLIP against Data Poisoning with Optimal Transport-based Matching and Alignment
Tong Zhang | Kuofeng Gao | Jiawang Bai | Leo Yu Zhang | Xin Yin | Zonghui Wang | Shouling Ji | Wenzhi Chen
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Tong Zhang | Kuofeng Gao | Jiawang Bai | Leo Yu Zhang | Xin Yin | Zonghui Wang | Shouling Ji | Wenzhi Chen
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Recent studies have shown that Contrastive Language-Image Pre-training (CLIP) models are threatened by targeted data poisoning and backdoor attacks due to massive training image-caption pairs crawled from the Internet. Previous defense methods correct poisoned image-caption pairs by matching a new caption for each image. However, the matching process solely relies on the global representations of images and captions, overlooking fine-grained features of visual and textual features. It may introduce incorrect image-caption pairs and detriment the CLIP pre-training. To address their limitations, we propose an Optimal Transport-based framework to reconstruct the image-caption pairs, named OTCCLIP. We involve a new optimal transport-based distance measure between fine-grained visual and textual feature sets and re-assign new captions based on the proposed optimal transport distance. Additionally, to further reduce the negative impact of mismatched pairs, we encourage the inter- and intra-modality fine-grained alignment by employing optimal transport-based objective functions. Our experiments demonstrate that OTCCLIP can successfully decrease the attack success rates of poisoning attacks to 0% in most cases. Also, compared to previous methods, OTCCLIPsignificantly improves CLIP’s zero-shot and linear probing performance trained on poisoned datasets.
Search
Fix author
Co-authors
- Zhiyuan Peng 2
- Jiawang Bai 1
- Yu-N Cheah 1
- Xu Chen 1
- Wenzhi Chen 1
- Hualong Chen 1
- Zhe Cui 1
- Zixiang Ding 1
- Zhenke Duan 1
- Kuofeng Gao 1
- Congqing He 1
- Haichuan Hu 1
- Shouling Ji 1
- Ran Jia 1
- Qingwei Lin 1
- Peiqin Lin 1
- Yongkang Liu 1
- Yuan Luo 1
- Chao Ni 1
- Rui Qian 1
- Saravan Rajmohan 1
- Suyi 1
- Yike Tan 1
- Lu Wang 1
- Qiang Wang 1
- Rui Wang 1
- Zonghui Wang 1
- Jiahao Wang 1
- Fangkai Yang 1
- Chenhao Ying 1
- Dongmei Zhang 1
- Yiang Zhang 1
- Hao Zhang 1
- Tong Zhang 1
- Leo Yu Zhang 1
- Hao Zhang 1
- Pu Zhao 1