BACKGROUND: The Fresno test is a useful instrument for measuring the evidence-based medicine (EBM) competence of family physicians and others. This study aimed to develop a Japanese version of the Fresno test. METHODS: First, the original version of the Fresno test was translated into Japanese following the standard instrument translation procedure. Subsequently, family medicine residents and certified physicians took the Japanese version of the Fresno test to assess its validity and reliability. RESULTS: Translation of the Fresno test into Japanese was completed successfully. A total of 39 participants took the test to verify reliability and validity. Family medicine specialists scored higher than majors (129.7 ± 36.0 vs. 100.6 ± 45.1, CONCLUSIONS: This study successfully developed a Japanese version of the Fresno test. This test has sufficient reliability and validity and is expected to be useful as an instrument in EBM education for physicians in the future.