Infant and neonatal mortality indicators are known to vary geographically, possibly as a result of socioeconomic and environmental inequalities. To better understand how these factors contribute to spatial and temporal patterns, we conducted a French ecological study comparing two time periods between 2002 and 2009 for three (purposefully distinct) Metropolitan Areas (MAs) and the city of Paris, using the French census block of parental residence as the geographic unit of analysis. We identified areas of excess risk and assessed the role of neighborhood deprivation and average nitrogen dioxide concentrations using generalized additive models to generate maps smoothed on longitude and latitude. Comparison of the two time periods indicated that statistically significant areas of elevated infant and neonatal mortality shifted northwards for the city of Paris, are present only in the earlier time period for Lille MA, only in the later time period for Lyon MA, and decrease over time for Marseille MA. These city-specific geographic patterns in neonatal and infant mortality are largely explained by socioeconomic and environmental inequalities. Spatial analysis can be a useful tool for understanding how risk factors contribute to disparities in health outcomes ranging from infant mortality to infectious disease—a leading cause of infant mortality.