Abstract
Cognitive aging researchers have been challenged with demonstrating age-related effects above and beyond global slowing ever since Cerella raised this issue in 1990. As the literature has made clear, this has indeed proved to be a difficult task and continues to plague the field. One way that researchers have attempted to test for disproportionate age differences across task conditions is by using Brinley plots, or plotting the mean response latencies of older adults against the mean latencies for younger adults. The simplicity and large proportion of variance accounted for by these models has led to the widespread use of Brinley plots over the years. However, as systematically tested here through eight cases of simulated data, it is clear that the Brinley technique is not well suited to either identify or display the underlying structure of datasets examining age-related differences in attentional control. Some of the problems with conventional Brinley plots can be resolved by using a modified Brinley plot that includes study-specific slopes linking trial types and a no-age-difference reference line. Multilevel models find all of the relevant effects, especially if applied to trial-level data, and have the advantage of incorporating study-level moderators that might account for slope heterogeneity. Ultimately, we encourage fellow cognitive aging researchers to access the code and data for this project on OSF (https://osf.io/zxus8/) and employ the use of multilevel models over Brinley plots.