Jizhou Guo
2026
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety
Wei-Chieh Huang | Henry Peng Zou | Yaozu Wu | Dongyuan Li | Yankai Chen | Weizhi Zhang | Yangning Li | Angelo Zangari | Jizhou Guo | Chunyu Miao | Liancheng Fang | Langzhou He | Yinghui Li | Renhe Jiang | Philip S. Yu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Wei-Chieh Huang | Henry Peng Zou | Yaozu Wu | Dongyuan Li | Yankai Chen | Weizhi Zhang | Yangning Li | Angelo Zangari | Jizhou Guo | Chunyu Miao | Liancheng Fang | Langzhou He | Yinghui Li | Renhe Jiang | Philip S. Yu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Deep research frameworks have shown promising capabilities in synthesizing comprehensive reports from web sources. While deep research possesses significant potential to address complex issues through planning and research cycles, existing frameworks are deficient in sufficient evaluation procedures and stage-specific protections. They typically treat evaluation as exact match accuracy of question-answering, but overlook crucial aspects of report quality such as credibility, coherence, breadth, depth, and safety. This oversight may result in hazardous or malicious sources being integrated into the final report. To address this, we introduce DeepResearchGuard, a framework featuring four-stage safeguards with open-domain evaluation, and DRSafeBench, a novel stage-wise safety benchmark. Evaluating across GPT-4o, o4-mini, Gemini-2.5-flash, DeepSeek-v3, and GPT-5, DeepResearchGuard improves defense success rates by an absolute 16.53% while reducing over-refusal rates to approximately 6%. Through extensive experiments, we show that DeepResearchGuard enables comprehensive open-domain evaluation and stage-aware defenses that effectively block harmful content propagation, while systematically improving report quality without excessive over-refusal rates.
2025
Model-based Large Language Model Customization as Service
Zhaomin Wu | Jizhou Guo | Junyi Hou | Bingsheng He | Lixin Fan | Qiang Yang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Zhaomin Wu | Jizhou Guo | Junyi Hou | Bingsheng He | Lixin Fan | Qiang Yang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Prominent Large Language Model (LLM) services from providers like OpenAI and Google excel at general tasks but often underperform on domain-specific applications. Current customization services for these LLMs typically require users to upload data for fine-tuning, posing significant privacy risks. While differentially private (DP) data synthesis presents a potential alternative, its application commonly results in low effectiveness due to the introduction of excessive noise on data for DP. To overcome this, we introduce *Llamdex*, a novel framework that facilitates LLM customization as a service, where the client uploads pre-trained domain-specific *models* rather than data. This client-uploaded model, optionally protected by DP with much lower noise, is inserted into the base LLM via connection modules. Significantly, these connecting modules are trained without requiring sensitive domain data, enabling clients to customize LLM services while preserving data privacy. Experiments demonstrate that Llamdex improves domain-specific accuracy by up to 26% over state-of-the-art private data synthesis methods under identical privacy constraints and, by obviating the need for users to provide domain context within queries, maintains inference efficiency comparable to the original LLM service.