Biodiversity is expected to change in response to future global warming. However, it is difficult to predict how species will track the ongoing climate change. Here we use the fossil record of planktonic foraminifera to assess how biodiversity responded to climate change with a magnitude comparable to future anthropogenic warming. We compiled time series of planktonic foraminifera assemblages, covering the time from the last ice age across the deglaciation to the current warm period. Planktonic foraminifera assemblages shifted immediately when temperature began to rise at the end of the last ice age and continued to change until approximately 5,000 years ago, even though global temperature remained relatively stable during the last 11,000 years. The biotic response was largest in the mid latitudes and dominated by range expansion, which resulted in the emergence of new assemblages without analogues in the glacial ocean. Our results indicate that the plankton response to global warming was spatially heterogeneous and did not track temperature change uniformly over the past 24,000 years. Climate change led to the establishment of new assemblages and possibly new ecological interactions, which suggests that current anthropogenic warming may lead to new, different plankton community composition.