Walls of Jericho were formed following the demise of two Detroit based bands. The first being the influential Earthmover, featuring members Mike Hasty (guitar) and Wes Keely (drums). The second was a band called Universal Stomp which Aaron Ruby (bass) played in. Both bands fizzled out at around the same time prompting the three friends to start a new band. At the same time Candace Kucsulain, 2 year singer for the band Apathemy auditioned with the band. After numerous other auditions for lead singer the band accepted Candace as their new frontwoman in September 1998. For the first few months the band would perform with friends of theirs filling in on guitar however later decided to ask close friend Chris Rawson in as full-time member who was able to offer more commitment to the band. With the line-up complete the five piece began touring the local Detroit hardcore scene. Soon after in April 1999 the band released their first EP on 7" through label Underestimated, which was followed shortly thereafter by a CD EP containing that 7" and demo tracks, called A Day and a Thousand Years released on Florida based Eulogy Recordings. This was later released by European imprint Genet. After continuous touring in support of their EP releases, the band attracted the attention of both Ferret and Trustkill Records. They went on to sign with Trustkill which resulted in the December 1999 release of their debut full-length album The Bound Feed the Gagged. The band hit the touring and hardcore festival circuit the following year. In August 2000 they began touring the United States in support of straight-edgers Earth Crisis, Swedish melodic death metal band In Flames, and Oakland, CA's metallic Skinlab. After another spate of touring in 2001, drummer Wes Keely announced he would be leaving the band to finish school in Seattle, Washington. With the band based in Detroit it would prove impossible for them to continue together. Keely was replaced by ex Suicide Machines drummer Derek Grant. Five months after touring with the band Grant announced he would be leaving to join Chicago punk rockers Alkaline Trio.