"My Heart" appears on Paramore's debut album, All We Know Is Falling. The album's central theme revolves around the departure of bassist Jeremy Davis, which happened shortly after the band arrived in Orlando, and this theme is reflected in the album's cover and title. The album itself is often categorized as pop-punk, though some critics have also described it as emo, pop rock, or alternative rock. At its heart, playing this song might feel like channeling the raw emotions of loss and change that shaped the band's early days.