The white marble domes of the Taj Mahal are iconic images of India that attract millions of visitors every year. Over the past several decades the outer marble surfaces of the Taj Mahal have begun to discolor with time and must be painstakingly cleaned every several years. Although it has been generally believed that the discoloration is in some way linked with poor air quality in the Agra region, the specific components of air pollution responsible have yet to be identified. With this in mind, ambient particulate matter (PM) samples were collected over a one-year period and found to contain relatively high concentrations of light absorbing particles that could potentially discolor the Taj Mahal marble surfaces, that include black carbon (BC), light absorbing organic carbon (brown carbon, BrC), and dust. Analyses of particles deposited to marble surrogate surfaces at the Taj Mahal indicate that a large fraction of the outer Taj Mahal surfaces are covered with particles that contain both carbonaceous components and dust. We have developed a novel approach that estimates the impact of these deposited particles on the visible light surface reflectance, which is in turn used to estimate the perceived color by the human eye. Results indicate that deposited light absorbing dust and carbonaceous particles (both BC and BrC from the combustion of fossil fuels and biomass) are responsible for the surface discoloration of the Taj Mahal. Overall, the results suggest that the deposition of light absorbing particulate matter in regions of high aerosol loading are not only influencing cultural heritage but also the aesthetics of both natural and urban surfaces.