Since the advent of the clustered regularly interspaced short palindromic repeats (CRISPR) system in the gene editing field, diverse CRISPR-based gene editing tools have been developed for treating genetic diseases. Of these, base editors (BEs) are promising because they can carry out precise gene editing at single-nucleotide resolution without inducing DNA double-strand breaks (DSBs), which pose significant risks of genomic instability. Despite their outstanding advantages, the clinical application of BEs remains challenging due to their large size, which limits their efficient delivery, particularly in adeno-associated virus (AAV)-based systems. To address this issue, various strategies have been explored to reduce the size of BEs. These approaches include truncating the nonessential domains and replacing the bulky components with smaller substitutes without compromising the editing efficiency. In this review, we highlight the importance of downsizing BEs for therapeutic applications and introduce recent advances in size-reduction strategies. Additionally, we introduce the ongoing efforts to overcome other limitations of BEs, providing insights into their potential for improving in vivo gene editing.