Prolonged demands on the attention system can cause a decay in performance over time known as the time-on-task effect. The inter-subject differences in the rate of this decline are large, and recent efforts have been made to understand the biological bases of these individual differences. In this study, we investigate the genetic correlates of the time-on-task effect, as well as its accompanying changes in subjective fatigue and mood. N = 332 subjects performed a 20-minute test of sustained attention (the Psychomotor Vigilance Test) and rated their subjective states before and after the test. We observed substantial time-on-task effects on average, and large inter-individual differences in the rate of these declines. The 10-repeat allele of the variable number of tandem repeats marker (VNTR) in the dopamine transporter gene and the Met allele of the catechol-o-methyl transferase (COMT) Val158Met polymorphism were associated with greater vulnerability to time-on-task. Separately, the exon III DRD4 48 bp VNTR of the dopamine receptor gene DRD4 was associated with subjective decreases in energy. No polymorphisms were associated with task-induced changes in mood. We posit that the dopamine transporter and COMT genes exert their effects by increasing dopaminergic tone, which may induce long-term changes in the prefrontal cortex, an important mediator of sustained attention. Thus, these alleles may affect performance particularly when sustained dopamine release is necessary.