Fugazi and Shellac, as well as Kentucky's own Rodan and Slint, Foxhole formed at Western Kentucky University in 2000. Featuring traditional instruments like bass, guitar, and drums as well as woodwinds, brass, and strings, their songs became increasingly engaged in hypnotic repetition and cinematic builds by the arrival of their full-length debut, We the Wintering Tree, in 2004. Life events involving geographic separation delayed their even more expansive second LP, Well Kept Thing, until 2018. It was mastered by Shellac's Bob Weston.
Adam Moore and Nathan McBroom began recording and performing as Foxhole in the early 2000s with a fluctuating lineup. Early shows involved improvisation and a variety of instruments, including glockenspiels, bottles, and signal generators in addition to homemade inventions (like the "juggophone," "shatterophone," and "pyrophone"). Between 2002 and 2003, the band released two EPs (EP1 and EP2:X) and toured for two weeks on the East Coast. Not long after, McBroom left the band, and the remaining members started taking a more direct approach to their music, grounding instrumentation in a core rock combo but expanding their sound with orchestral instruments. In 2004, Seleh Records became interested in the group and funded its first full-length, We the Wintering Tree. It featured the lineup of Moore (guitar, piano), Justin R. Shepherd (guitar), Greg Leppert (brass), Derek Holt (bass), and Matthew Wilson (drums). Wilson didn't stay on with Foxhole, and a few replacement drummers were used for live shows before the band decided on Jason Torrence, former drummer for Nashville act God's Lonely Man. They started playing shows on a more regular basis and after a year-and-a-half of recording, Foxhole finished their third EP, Push/Pull, in mid-2006. Because of the dense production, Brian Toppenberg was added to fill in the gaps for live shows. The band then signed with Philadelphia label Burnt Toast Vinyl, which reissued the EP in January 2007. The label also reissued the band's debut LP in 2008.
After some time-off following touring, Foxhole got back together in early 2010 for sessions in Nashville with Chris Vicari replacing Torrence on drums. However, life events soon pulled members in different directions across the country, and they found themselves on an indefinite hiatus. They reunited in Bowling Green in late 2016 to revisit the recordings and did some additional sessions. Featuring Moore, Shepherd, Leppert, Holt, and Vicari, the resulting Well Kept Thing saw a multi-format release by Burnt Toast Vinyl in 2018.