In 2020, the coronavirus disease 2019 (COVID-19) pandemic altered lifestyles dramatically. We previously reported that the physical function of walk-in rehabilitation users in Japan worsened after the state of emergency declaration and continued to worsen until the end of 2020. However, whether physical function continued to worsen during the prolonged pandemic period remains unclear. This study aimed to characterize the impact of the COVID-19 pandemic on community-dwelling people with disabilities. Data measured every 3 to 6 months from January 2018 to December 2022 were examined retrospectively for patients who started using day care services by July 2018 and continued until July 2022. Every 6 months was considered one period. Mixed-effects model repeated measures (MMRMs) were performed, including missing measurements for 10 periods from the first half of 2018 to the second half of 2022, and each period was tested for multiple comparisons. The MMRM showed that both walking speed (