Dedicated maps for cognitive quantities such as timing, size and numerosity support the view that topography is a general principle of brain organization. To date, however, all of these maps were driven by the visual system. Here, we ask whether there are supramodal topographic maps representing cognitive dimensions irrespective of the stimulated sensory modality. We measured haptically and visually driven numerosity-selective neural responses using model-based analyses and ultra-high field (7T) fMRI. We found topographically organized neural populations tuned to haptic numerosity. The responses to visual or haptic numerosity shared a similar cortical network. However, the maps of the two modalities only partially overlap. Thus, although both visual and haptic numerosities are processed in a similar supramodal functional network, the underlying neural populations may be related, but distinct. Therefore, we hypothesize that overlap between modality-specific maps facilitates cross-modal interactions and supramodal representation of cognitive quantities.