One part of aquaculture sustainability is reducing the environmental footprint of aquaculture feeds. For European aquaculture, this means finding feed ingredients that are produced within the economic community, and that are not in conflict with human consumption. This is especially challenging when formulating diets for carnivorous fish such as turbot with low tolerance to fishmeal replacement that are both nutritious and economically and environmentally sustainable. Therefore, we investigated the effects of two novel and innovative feed formulation concepts on growth and feed performance and the nutritional status of market-sized turbot in a recirculating aquaculture system. In a 16-week feeding trial, 440 turbot (300 ± 9 g) were fed twice a day with a control diet (CTRL), based on a commercial formulation, and four experimental diets. The experimental diets were designed to investigate the effects of two formulations concepts based on sustainable terrestrial plant proteins (NoPAP) or processed animal proteins (PAP) and of 30% and 60% fishmeal replacement with emerging feed ingredients (fisheries by-products, insect meal and fermentation biomass). Turbot from the CTRL group had a similar growth and feed performance than fish fed the NoPAP30 formulation, with a significant decline of performance in the fish fed both PAP formulations and the NoPAP60. Comparing the two formulation concepts with each other the voluntary feed intake and protein efficiency ratio on tank basis as well as the individual weight gain and relative growth rate was significantly higher in the fish from the NoPAP groups than PAP groups. Furthermore, the apparent digestibility of nutrients and minerals was significantly reduced in the fish fed with the diets with 30% and 60% fishmeal replacement level compared to the fish from the CTRL group. In conclusion, the performance of the fish fed the NoPAP30 formulation concept highlights the potential of the used combination of sustainable ingredients, such as fisheries by-products, insect meal, microbial biomass and plant protein for turbot. Furthermore, this study shows that turbot has a higher tolerance to the incorporation of plant and insect protein than of processed animal protein.