ZhongJingGPT: An Expert Knowledge-Guided Language Model for Traditional Chinese Medicine

Traditional Chinese Medicine (TCM) presents unique challenges for Large Language Models (LLMs) due to its complex diagnostic reasoning. We introduce ZhongJingGPT, a specialized LLM for TCM that integrates vertical domain fine-tuning strategies with cognitive psychology insights. Our approach incorporates multi-TCM scenario and knowledge instruction construction strategies, enhanced by symptom sequence-based beam search and a Medical Finite State Machine (MedicalFSM) module. Using only Low-Rank Adaptation (LoRA) fine-tuning, ZhongJingGPT achieves state-of-the-art accuracy, surpassing Generative Pre-trained Transformer 4 (GPT-4) in key TCM-specific accuracy and fluency metrics. Comprehensive evaluations, including out-of-distribution assessments, renowned TCM practitioners’ case studies, and multi-turn role-playing scenarios, verify its superior performance on Chinese Massive Multitask Language Understanding (CMMLU) and TCM humanities datasets. A multi-dimensional evaluation standard, assessed by professional practitioners, further validates its effectiveness. This research demonstrates the potential of specialized LLMs in TCM and offers insights for Artificial Intelligence (AI) development in complex professional domains, bridging ancient wisdom with modern artificial intelligence technologies.