The fascinating results of Lorenzi et al. (2025) suggest that the number sense is innate. Many readers might find this conclusion disturbing. Here, I explore the deep cognitive origins of this sentiment. Empiricism, I suggest, is deeply grounded in human nature. This conclusion obviously does not license us to assume that knowledge is innate, but it does suggest caution against heeding our skeptical gut reaction.