Pisha sandstone is a soft rock found in the southern zone of the Inner Mongolia Autonomous Region of Inner Mongolia. The presence of soft Pisha sandstone in the middle reaches of the Yellow River coincides with large areas of bedrock erosion in the river’s basin, with the average total erosion modulus as high as 44570 t/(km²·a). Such high levels of erosion are one of the main sources of coarse mud and sands in the Yellow River. Erosion by gravitational forces such as snow glide and landslip are the main erosion types in Pisha sandstone region. The gravity erosion modulus can be as high as 25615 t/(km²·a), accounting for 30.6% of the total average erosion. Our paper investigates the characteristics of Pisha sandstone in relation to the development of gravity erosion mechanisms. We conducted field investigations in Pisha sandstone region for original state rock sampling. Test results from analyses of the rock properties indicate that the mineral composition, structure and microstructure characteristics of Pisha sandstone determine its varying capacity to resist weathering. Degrees of weathering in slightly different lithological layers of Pisha sandstone lead to different erosion rates. In this way, erosion forces combined with the varying lithological strata in the rock aggravate gravitational erosion in Pisha sandstone.