The mechanical properties of the carbon fiber-reinforced polymer composites (CFRPs) are dependent on the interfacial interaction and adhesion between carbon fibers (CFs) and polymer matrices. Therefore, it is crucial to understand how modifying the CFs can influence the properties of these composites. This review outlines recent research progress with a focus on the relationship between the interfacial and mechanical properties of CFRPs and provides a systematic summary of state-of-the-art surface modification techniques. These techniques are divided into four categories: (i) wet, (ii) electrochemical, (iii) dry, and (iv) polymer matrix modifications. Several strategies for enhancing the interfacial interactions and adhesion of CFRPs are discussed, providing insights for future trends.