Abstract
The discrete behavioral events captured on the smartphone touchscreen may help unravel real-world neural processing. We find that neural signals (EEG) surrounding a touchscreen event show a distinctly contralateral motor preparation followed by visual processing, and the consolidation of information. We leveraged these events in conjunction with kinematic recordings of the thumb and an artificial neural network to separate highly similar movements according to whether they resulted in a smartphone touch (goal-directed) or not (non-goal-directed). Despite their kinematic similarity, the signatures of neural control of movement and the post-movement processing were substantially dampened for the non-goal-directed movements, and these movements uniquely evoked error-related signals. We speculate that these apparently unnecessary movements are common in the real world and although inconsequential the brain provides limited motor preparation and tracks the action outcome. The neural signals surrounding discrete smartphone events can enable the study of neural processes that are difficult to capture in conventional laboratory-based tasks.