The aim of this study was to investigate the relationship between childhood trauma (CT) and cognitive functioning in individuals with ultra-high risk for psychosis (UHR). Fifty-three individuals at UHR for psychosis were administered a neurocognitive battery that assessed attention, processing speed, verbal learning, memory, working memory, interference inhibition, and sustained attention. The CT was assessed using the short-version Childhood Trauma Questionnaire (CTQ). We dichotomized the sample by using cut-off scores for the presence of emotional, physical and sexual trauma, and physical and emotional neglect. Those with a history of physical trauma performed worse on the Digit Span Forward test, Trail making B (time), Stroop test (difference between color and word reading times), and completed categories of the Wisconsin Card Sorting Test (WCST). Physical trauma scores were correlated with WCST-completed categories, Digit Span Forward and Stroop test scores. Physical neglect scores were negatively correlated with Digit Span Forward Test scores. Most of the significant dose-response relationships between cognitive impairment and different subtypes of CT were found only in men. There was no difference between those with and without other kinds of childhood abuse or neglect in terms of cognitive impairment.