We thoroughly analyse the double-layer potential's role in approaches to spectral sets in the spirit of Delyon-Delyon, Crouzeix and Crouzeix-Palencia. While the potential is well-studied, we aim to clarify on several of its aspects in light of these references. In particular, we illustrate how the associated integral operators can be used to characterize the convexity of the domain and the inclusion of the numerical range in its closure. We furthermore give a direct proof of a result by Putinar-Sandberg-a generalization of Berger-Stampfli's mapping theorem-circumventing dilation theory. Finally, we show for matrices that any smooth domain whose closure contains the numerical range admits a spectral constant only depending on the extremal function and vector. This constant is consistent with the so far best known absolute bound