Three Modes of Adaptive Speciation in Spatially Structured Populations

Adaptive speciation with gene flow via the evolution of assortative mating has classically been studied in one of two different scenarios. First, speciation can occur if frequency-dependent competition in sympatry induces disruptive selection, leading to indirect selection for mating with similar phenotypes. Second, if a subpopulation is locally adapted to a specific environment, then there is indirect selection against hybridizing with maladapted immigrants. While both of these mechanisms have been modeled many times, the literature lacks models that allow direct comparisons between them. Here we incorporate both frequency-dependent competition and local adaptation into a single model and investigate whether and how they interact in driving speciation. We report two main results. First, we show that individually, the two mechanisms operate under separate conditions, hardly influencing each other when one of them alone is sufficient to drive speciation. Second, we also find that the two mechanisms can operate together, leading to a third speciation mode in which speciation is initiated by selection against maladapted migrants but completed by within-deme competition in a distinct second phase. While this third mode bears some similarity to classical reinforcement, it is considerably faster, and both newly formed species go on to coexist in sympatry.