Although soil pH has been shown to be an important factor driving microbial communities, relatively little is known about the other potentially important factors that shape soil-borne microbial community structure. This study examined plant and microbial communities across a series of neutral pH fields (pH=7.0–7.5) representing a chronosequence of secondary succession after former arable fields were taken out of production. These fields ranged from 17 to >66 years since the time of abandonment, and an adjacent arable field was included as a reference. Hierarchical clustering analysis, nonmetric multidimensional scaling and analysis of similarity of 52 different plant species showed that the plant community composition was significantly different in the different chronosequences, and that plant species richness and diversity increased with time since abandonment. The microbial community structure, as analyzed by phylogenetic microarrays (PhyloChips), was significantly different in arable field and the early succession stage, but no distinct microbial communities were observed for the intermediate and the late succession stages. The most determinant factors in shaping the soil-borne microbial communities were phosphorous and NH4+. Plant community composition and diversity did not have a significant effect on the belowground microbial community structure or diversity.