Impulsivity, venturesomeness, and pride variables were examined as potential moderators of the associations between childhood trauma and physical aggression, alcohol use and physical aggression, and drug use and physical aggression. Participants (n = 457) were college students recruited from a university in the Southeast. It was hypothesized that childhood trauma, alcohol use, and drug use would be associated with increased scores of physical aggression. In addition, it was hypothesized that impulsivity, venturesomeness, authentic pride, and hubristic pride would moderate these relationships. Linear, multivariate hierarchical regression analyses were used to examine these variables as potential moderators. Hypotheses concerning hubristic pride as a moderator of the relationship between alcohol use and physical aggression as well as the relationship between drug use and physical aggression were supported. In addition, the hypothesis concerning authentic pride as a moderator of the relationship between alcohol use and physical aggression was supported albeit in the opposite direction than predicted. Hypotheses concerning the moderating roles of impulsivity and venturesomeness were not supported. Findings support the idea that the deleterious psychological effects of substance use can be compounded by personality factors such as authentic and hubristic pride. The discussion encompasses why interventions should target attributions and cognitions and why simply encouraging someone to have a more “healthy pride” is likely to be ineffective at reducing physical aggression in the context of drug use and alcohol use.