It is widely assumed that the ventilation of the Southern Ocean played a crucial role in driving glacial‐interglacial atmospheric CO2 levels. So far, however, ventilation records from the Indian sector of the Southern Ocean are widely missing. Here we present reconstructions of water residence times (depicted as ΔΔ14C and Δδ13C) for the last 32,000 years on sediment records from the Kerguelen Plateau and the Conrad Rise (~570‐ to 2,500‐m water depth), along with simulated changes in ocean stratification from a transient climate model experiment. Our data indicate that Circumpolar Deep Waters in the Indian Ocean were part of the glacial carbon pool. At our sites, close to or bathed by upwelling deep waters, we find two pulses of decreasing ΔΔ14C and δ13C values (~21–17 ka; ~15–12 ka). Both transient pulses precede a similar pattern in downstream intermediate waters in the tropical Indian Ocean as well as rising atmospheric CO2 values. These findings suggest that 14C‐depleted, CO2‐rich Circumpolar Deep Water from the Indian Ocean contributed to the rise in atmospheric CO2 during Heinrich Stadial 1 and also the Younger Dryas and that the southern Indian Ocean acted as a gateway for sequestered carbon to the atmosphere and tropical intermediate waters.