Immune responses to pathogens are complex and not well understood in many diseases, and this is especially true for infections by persistent pathogens. One mechanism that allows for long-term control of infection while also preventing an over-zealous inflammatory response from causing extensive tissue damage is for the immune system to balance pro- and anti-inflammatory cells and signals. This balance is dynamic and the immune system responds to cues from both host and pathogen, maintaining a steady state across multiple scales through continuous feedback. Identifying the signals, cells, cytokines, and other immune response factors that mediate this balance over time has been difficult using traditional research strategies. Computational modeling studies based on data from traditional systems can identify how this balance contributes to immunity. Here we provide evidence from both experimental and mathematical/computational studies to support the concept of a dynamic balance operating during persistent and other infection scenarios. We focus mainly on tuberculosis, currently the leading cause of death due to infectious disease in the world, and also provide evidence for other infections. A better understanding of the dynamically balanced immune response can help shape treatment strategies that utilize both drugs and host-directed therapies.