Vaccines are a crucial tool for controlling infectious diseases, yet rarely offer perfect protection. 'Vaccine efficacy' describes a population-level effect measured in clinical trials, but mathematical models used to evaluate the impact of vaccination campaigns require specifying how vaccines fail at the individual level, which is often impossible to measure. Does 90% efficacy imply perfect protection in 90% of people and no protection in 10% ('all-or-nothing') or that the per-exposure risk is reduced by 90% in all vaccinated individuals ('leaky') or somewhere in between? Here, we systematically investigate the role of vaccine failure mode in controlling ongoing epidemics. We find that the difference in population-level impact between all-or-nothing and leaky vaccines can be substantial when