Neuroendocrine prostate cancer (NEPC) arises primarily through neuroendocrine transdifferentiation (NEtD) as an adaptive mechanism of therapeutic resistance. Models to define the functional effects of putative drivers of this process on androgen receptor (AR) signaling and NE cancer lineage programs are lacking. We adapted a genetically defined strategy from the field of cellular reprogramming to directly convert AR-active prostate cancer (ARPC) to AR-independent NEPC using candidate factors. We delineated critical roles of the pioneer factors ASCL1 and NeuroD1 in NEtD and uncovered their abilities to silence AR expression and signaling by remodeling chromatin at the somatically acquired AR enhancer and global AR binding sites with enhancer activity. We also elucidated the dynamic temporal changes in the transcriptomic and epigenomic landscapes of cells undergoing acute lineage conversion from ARPC to NEPC which should inform future therapeutic development. Further, we distinguished the activities of ASCL1 and NeuroD1 from the inactivation of RE-1 silencing transcription factor (REST), a master suppressor of a major neuronal gene program, in establishing a NEPC lineage state and in modulating the expression of genes associated with major histocompatibility complex class I (MHC I) antigen processing and presentation. These findings provide important, clinically relevant insights into the biological processes driving NEtD of prostate cancer.