Currently, characterization of soil microbial communities relies heavily on the use of molecular approaches. Independently of the approach used, soil DNA extraction is a crucial step, and success of downstream procedures will depend on how well DNA extraction was performed. Often, studies describing and comparing soil microbial communities are based on a single DNA extraction, which may not lead to a representative recovery of DNA from all organisms present in the soil. The use of successive DNA extractions might improve soil microbial characterization, but the benefit of this approach has only been limitedly studied. To determine whether successive DNA extractions of the same soil sample would lead to different observations in terms of microbial abundance and community composition, we performed three successive extractions, with two widely used commercial kits, on a range of clay and sandy soils. Successive extractions increased DNA yield considerably (1–374%), as well as total bacterial and fungal abundances in most of the soil samples. Analysis of the 16S and 18S ribosomal RNA genes using 454-pyrosequencing, revealed that microbial community composition (taxonomic groups) observed in the successive DNA extractions were similar. However, successive DNA extractions did reveal several additional microbial groups. For some soil samples, shifts in microbial community composition were observed, mainly due to shifts in relative abundance of a number of microbial groups. Our results highlight that performing successive DNA extractions optimize DNA yield, and can lead to a better picture of overall community composition.