Sediment discharge signi?cantly decreased in the Yellow River because of the effect of the ‘grain-for-green project’ (GGP). The typical watershed parsing method was applied to obtain the sediment yield and analyze the variation of the annual erosion modulus in a typical watershed in the loess hilly-gully region between 2003 and 2011. The results indicated that that sediment yield from the watershed declined dramatically, and the average erosion modulus was less than 500 t/km2?a, which was 8.3% of that before the implementation of GGP. Moreover, when excluding the data in 2003 because of the influence of the beginning of dam implement, the average erosion modulus during 2004-2011 was 144.93 t/km2?a, which was only 2.4% of that before the implementation of GGP, suggesting that there was a mild erosion in this watershed after the GGP. This study proved the significance of the effects of controlling sediment yield of the GGP, and it may help the planners and managers to make proper decisions for the control of soil erosion from watersheds under similar conditions.