Recently, surface enhanced Raman scattering (SERS) labels have attracted researchers’ attention owing to their high sensitivity, excellent multiplexing ability, insensitivity to photobleaching and good fidelity of molecular fingerprint, and have been successfully applied to sensing analysis and biological imaging. In this review, we summarize the principle of SERS label-based biosensors, and the state of the art in their application for rapid detection of pesticide residues. The focus of this review is on the design and fabrication of SERS labels and the current status of sensing systems based on different recognition elements. Meanwhile, the challenges in this field are discussed and possible solutions to them are proposed. This review is expect to help expand the application of SERS labels in the detection of pesticide residues and food safety.