The extraction of rolling bearing fault features using traditional diagnostic methods is not sufficiently comprehensive and the features are often chosen subjectively and depend on human experience. In this paper, an improved deep convolutional process is used to extract a set of features adaptively. The hidden multi-layer feature of deep convolutional neural networks is also exploited to improve the extraction features. A deterministic detection of low-confidence samples is performed to ensure the reliability of the recognition results and to decrease the rate of false positives by evaluating the diagnosis of the deep convolutional neural network. To improve the efficiency of the continuous learning elements of the rolling bearing fault diagnosis, a clone learning strategy based on cloning and mutation operations is proposed. The experimental results show that the proposed deep convolutional neural network model can extract multiple rolling bearing fault features, improve classification and detection accuracy by reducing the false positive rate when diagnosing rolling bearing faults, and accelerate learning efficiency when using low-confidence rolling bearing fault samples.