He played the banjo professionally before he played the guitar. Jerry loved bluegrass.
Fun fact, the lyrics were originally about Mickey Hart’s dad, who briefly served as the band’s manager, before absconding with a lot of their money. Steal your face right off your head, indeed. Later the song was often played after someone close to the band died, as a sort of eulogy.