Our ability to extract three-dimensional (3-D) object structure from motion-carried information is a basic visual capacity that is fundamental to object perception. Despite a rich body of behavioral work demonstrating that infants are sensitive to motion-carried information from the early months of life, little is known about the cortical networks that support infants’ use of motion-carried information to extract 3-D object structure. This study assessed patterns of cortical activation in infants aged 4 to 6 months as they viewed two types of visual stimuli: (a) shape-from-motion (SFM) displays, where coherent motion of randomly distributed dots gave rise to the percept of 3-D shape and (b) random motion (RM) displays, where dots’ motions lacked a coherent structure and gave rise to the percept of randomly moving dots. Functional near-infrared spectroscopy was used to assess activation in occipital, inferior parietal, and posterior temporal cortex. The optical imaging data revealed differential responding to SFM and RM in lower level object processing areas than typically observed in the adult. Possible explanations for this pattern of results are considered.