This study was conducted within the context of the English for Specific Department (ESPD), Hanoi University. The research aimed to find out the level of speaking anxiety among freshmen at ESPD as well as the factors that influence their speaking anxiety. A quantitative approach was employed with the use of the Public Speaking Class Anxiety Scale (PSCAS) to obtain the responses from 75 students currently studying a one-year intensive English course at ESPD, majoring in different fields. Following that, the data was analyzed by SPSS IBM software with the descriptive analysis and frequency analysis. The results of the case study stated that these students experienced a medium level of speaking anxiety. In addition, the fear of negative evaluation is perceived by students as the most significant factor affecting their speaking anxiety, followed by communication apprehension and test anxiety.