Evidence is accumulating that short-chain fatty acids (SCFAs) produced by the gut microbiota play pivotal roles in host metabolism. They contribute to the metabolic regulation and energy homeostasis of the host not only by preserving intestinal health and serving as energy substrates but also by entering the systemic circulation as signaling molecules, affecting the gut-brain axis and neuroendocrine-immune network. This review critically summarizes the current knowledge regarding the effects of SCFAs in the fine-tuning of the pathogenesis of type 2 diabetes mellitus (T2DM) and insulin resistance, with an emphasis on the complex relationships among diet, microbiota-derived metabolites, T2DM inflammation, glucose metabolism, and the underlying mechanisms involved. We hold an optimistic view that elucidating how diet can influence gut bacterial composition and activity, SCFA production, and metabolic functions in the host will advance our understanding of the mutual interactions of the intestinal microbiota with other metabolically active organs, and may pave the way for harnessing these pathways to develop novel personalized therapeutics for glucometabolic disorders.