The neurobiological mechanisms underlying the connection between anxiety brought on by social stressors and the negative impact on relationship formation have remained elusive. In order to address this question, we used the social defeat model in the socially monogamous prairie vole to investigate the impact of this stress on pair bond formation. Social defeat experience inhibited partner preference formation in males but promoted preference in females. Furthermore, pair bonding increased corticotropin-releasing hormone (CRH) expression in the bed nucleus of the stria terminalis (BNST) in male prairie voles, while defeat experience increased BNST CRH expression in females. Chemogenetic excitation of BNST CRH neurons during a short cohabitation with a new partner promoted a partner preference in stress-naïve prairie voles. Interestingly, chemogenetic inhibition of BNST CRH neurons during cohabitation with a new partner blocked partner preference in stress-naïve males but promoted preference in defeated males. Inhibition of BNST CRH neurons also blocked partner preference in stress-naïve females but did not alter preference behavior in defeated females. This study revealed sexual dimorphism in not only the impact of social defeat on pair bond formation, but also in the role BNST CRHergic neurons play in regulating changes in pair bonding following social conflict.