Cellular RNA labeling using light-up aptamers that bind to and activate fluorogenic molecules has gained interest in recent years as an alternative to protein-based RNA labeling approaches. Aptamer-based systems are genetically encodable and cover the entire visible spectrum. However, the inherently temporary nature of the noncovalent aptamer-fluorogen interaction limits the utility of these systems in that imaging does not withstand dye washout, and dye dissociation can compromise RNA tracking. We propose that these limitations can be averted through covalent RNA labeling. Here, we describe a photoaffinity approach in which the aptamer ligand is functionalized with a photoactivatable diazirine reactive group such that irradiation with UV light results in covalent attachment to the RNA of interest. In addition to the robustness of the covalent linkage, this approach benefits from the ability to achieve spatiotemporal control over RNA labeling. To demonstrate this approach, we incorporated a photoaffinity linker into malachite green and fused a single copy of the malachite green aptamer to a Cajal body-associated small nuclear RNA of interest as well as a cytoplasmic mRNA. We observed improved sensitivity for live cell imaging of the target RNA upon UV irradiation and demonstrated visualization of RNA dynamics over a time scale of minutes. The covalent attachment uniquely enables these time-resolved experiments, whereas in noncovalent approaches, the dye molecule can be transferred between different RNA molecules, compromising tracking. We envision future applications of this method for a wide range of investigations into the cellular localization, dynamics, and protein-binding properties of cellular RNAs.