Ephesians 2:4-9: "4 But God, being rich in mercy, because of the great love with which he loved us, 5 even when we were dead in our trespasses, made us alive together with Christ - by grace you have been saved - 6 and raised us up with him and seated us with him in the heavenly places in Christ Jesus, 7 so that in the coming ages he might show the immeasurable riches of his grace in kindness toward us in Christ Jesus. 8 For by grace you have been saved through faith. And this is not your own doing; it is the gift of God, 9 not a result of works, so that no one may boast."
Titus 3:4-7: "4 But when the goodness and loving kindness of God our Savior appeared, 5 he saved us, not because of works done by us in righteousness, but according to his own mercy, by the washing of regeneration and renewal of the Holy Spirit, 6 whom he poured out on us richly through Jesus Christ our Savior, 7 so that being justified by his grace we might become heirs according to the hope of eternal life."
Isaiah 64:6: "We have all become like one who is unclean, and all our righteous deeds are like a polluted garment. We all fade like a leaf, and our iniquities, like the wind, take us away."
Romans 3:23-24: "23 for all have sinned and fall short of the glory of God, 24 and are justified by his grace as a gift, through the redemption that is in Christ Jesus"
+++
The text is public domain:
By grace I'm saved, grace free and boundless;My soul, believe and doubt it not.Why stagger at this word of promise?Has Scripture ever falsehood taught?No! Then this word must true remain:By grace you too will life obtain.
By grace! None dare lay claim to merit;Our works and conduct have no worth.God in His love sent our Redeemer,Christ Jesus, to this sinful earth;HIs death did for our sins atone,And we are saved by grace alone.
By grace God's Son, our only Savior,Came down to earth to bear our sin.Was it because of your own meritThat Jesus died your soul to win?No, it was grace, and grace alone,That brought Him from His heav'nly throne.
By grace! This ground of faith is certain;As long as God is true, it stands.What saints have penned by inspiration,What in His Word our God commands,Our faith in what our God has doneDepends on grace - grace through His Son.
By grace to timid hearts that tremble,In tribulation's furnace tried,By grace, in spite of fear and trouble,The Father's heart is open wide.Where could I help and strength secureIf grace were not my anchor sure?
By grace! On this I'll rest when dying;In Jesus' promise I rejoice;For though I know my heart's condition,I also know my Savior's voice.My heart is glad, all grief has flownSince I am saved by grace alone.
+++
Parts of these passages are similar enough that - with one exception - it's difficult to tell where or if the hymn draws from one more than the others. The line "Our works and conduct have no worth" seems to come from "all our righteous deeds are like a polluted garment" in Isaiah 64:6.