Wellbore stability is a key factor affecting safe and efficient drilling. At present, it is difficult to conduct real-time and accurate analysis of wellbore stability in related research. To address the current research shortcomings, this study proposes a real-time analysis model of wellbore stability integrating image recognition and an expert system, which mainly includes caving image segmentation and recognition, and a wellbore stability expert system. The caving image recognition proposes a new dynamic threshold segmentation method based on simple linear iterative clustering superpixel segmentation and visual geometry group 19-layer image classification. After completing the segmentation of the caving image, the geometric features of the caving are calculated, and the multi-source feature fusion GoogleNet model is established by integrating the geometric features with the convolution features extracted by GoogleNet to identify the caving types efficiently. After segmentation and recognition of caving images. The wellbore stability expert system uses the caving features to establish an expert system model to determine the mechanism of wellbore instability and provide reasonable solutions. Finally, the wellbore stability integrating image recognition and an expert system model was applied to a well in field production, accurately determining the mechanism of wellbore instability in real time and effectively solving the corresponding wellbore instability problem based on the measures provided by the model.