The intensification of Northern Hemisphere glaciations at the end of the Pliocene epoch marks one of the most substantial climatic shifts of the Cenozoic. Despite global cooling, sea surface temperatures in the high latitude North Atlantic Ocean rose between 2.9–2.7 million years ago. Here we present sedimentary geochemical proxy data from the Gulf of Cadiz to reconstruct the variability of Mediterranean Outflow Water, an important heat source to the North Atlantic. We find evidence for enhanced production of Mediterranean Outflow from the mid-Pliocene to the late Pliocene which we infer could have driven a sub-surface heat channel into the high-latitude North Atlantic. We then use Earth System Models to constrain the impact of enhanced Mediterranean Outflow production on the northward heat transport in the North Atlantic. In accord with the proxy data, the numerical model results support the formation of a sub-surface channel that pumped heat from the subtropics into the high latitude North Atlantic. We further suggest that this mechanism could have delayed ice sheet growth at the end of the Pliocene.