"Home" is sung to a D note, the tonic note (the "home" note) in D major, so there's a musical representation of this "home" too.
Looking at the hymn again recently, I noticed something about the line "My heart shall bloom forever" in the second verse, sung to this phrase:
"Forever" is sung with a melisma (A A G# A), and since it's stretched out, there's a musical sense of that long period of time.
Looking over the hymn in order to write this post, I found a few Biblical references that I'd missed when I wrote about them back in December 2016. The third verse begins with the lines "I lay in fetters, groaning; / You came to set me free," which comes from Isaiah 61:1: "The Spirit of the Lord GOD is upon me, because the LORD has anointed me to bring good news to the poor; he has sent me to bind up the brokenhearted, to proclaim liberty to the captives, and the opening of the prison to those who are bound," which Jesus quotes in Luke 4:18.
The third verse ends with the lines "A glorious crown You give me, / A treasure safe on high / That will not fail or leave me / As earthly riches fly." The "glorious crown" seems to come from a section of Revelation 2:10: "'Be faithful unto death, and I will give you the crown of life.'" The final three lines use the same imagery that Jesus uses in Matthew 6:19-20: "'Do not lay up for yourselves treasures on earth, where moth and rust destroy and where thieves break in and steal, 20 but lay up for yourselves treasures in heaven, where neither moth nor rust destroys and where thieves do not break in and steal.'"
