Although diabetes mellitus is strongly associated with dementia, the mechanism underlying diabetes-induced cognitive dysfunction has not been clarified. Here, we demonstrate the vital role of repulsive guidance molecule A (RGMa) in the regulation of adult hippocampal neurogenesis and cognitive impairment under diabetic conditions. In type 2 diabetic db/db mice and streptozotocin-mediated type 1 diabetic mice, RGMa is upregulated in the granular cell layer of the dentate gyrus. Additionally, both neural stem cells (NSCs) and immature neurons express its receptor, neogenin. In vitro experiments revealed that high glucose-conditioned hippocampal neurons inhibited the differentiation of NSCs, and the application of an anti-RGMa antibody restored it. The treatment with an anti-RGMa antibody ameliorated diabetes-induced cognitive decline and impairment of hippocampal neurogenesis. These findings suggest that the RGMa negatively regulates hippocampal neurogenesis and is involved in diabetes mellitus-induced cognitive decline.