Abstract
Cell sorting by differential adhesion is one of the basic mechanisms explaining spatial organization of neurons in early stage brain development of fruit flies. The columnar arrangements of neurons determine the large-scale patterns in the fly visual center. Experimental studies indicate that hexagonal configurations regularly appear in the fly compound eye, which is connected to the visual center by photoreceptor axons, while tetragonal configurations can be induced in mutants. We need a mathematical framework to study the mechanisms of such a transition between hexagonal and tetragonal arrangements. Here, we propose a new mathematical model based on macroscopic approximations of agent-based models that produces a similar behavior changing from hexagonal to tetragonal steady configurations when medium-range repulsion and longer-range attraction between individuals are incorporated in previous successful models for cell sorting based on adhesion and volume constraints. We analyze the angular configurations of these patterns based on angle summary statistics and compare between experimental data and parameter fitted ARA (Adhesion-Repulsion-Attraction) models showing that intermediate patterns between hexagonal and tetragonal configuration are common in experimental data as well as in our ARA mathematical model. Our studies indicate an overall qualitative agreement of ARA models in tile patterning and pave the way for their quantitative studies. Our study opens up a new avenue to explore tile pattern transitions, found not only in the column arrangement in the brain, but also in the other related biological processes.