"There She Goes Again" is the prototypical lo-fi, jangle rock song. Driven by Lou Reed's guitar, Sterling Morrison's bass, and, in this case, the tiny percussion of Mo Tucker, the song is a showcase for Reed's distinct vocal stylings with a great riff and light pop refrain ("There she goes") at its core. Because the New York band is better known for its sonic and experimental work in the '60s, "There She Goes Again" is an anomaly (though they made a handful of jangle-poppers like "Beginning to See the Light") in the Velvets' rich and dissonant catalog. The lyric's less than woman-friendly nature made it a surprise that the young and politically correct R.E.M. recorded a straight version of the song as a B-side to the 1983 reissue of the single "Radio Free Europe" (it also appears on the CD Dead Letter Office). The song was one of the Georgia band's early concert staples; because they also recorded the Velvets' "Pale Blue Eyes," R.E.M. is often cited as having sparked an unofficial Velvet Underground revival in the '80s. The result of R.E.M.'s flag-waving on the Velvets' behalf resulted in the reissue of the band's long out-of-print recordings, making "There She Goes Again" as accessible on disc as it is as a pop song.