Writings by Kemp include the following published items:
- Measure of a Heart, and Other Poems, Golden Quill, 1962.
- Shining Towers of Faith, and Other Poems, Johnson Publishing Co. (Murfreeboro, NC), 1966.
- Measure for Living: Devotions and Poems of Affirmation, C.R. Gibson, 1967.
- Testaments of Faith (poems), C.R. Gibson, 1970.
- The Shield of Faith, C.R. Gibson, 1973.
- Represented in several anthologies, including This Singing Earth, edited by Lilith Lorraine, Flame Press, 1961.
- Rhyme Time for the Very Young, edited by Jeanne Hollyfield, Young Publications, 1964.
- Gold Star Anthology, edited by Marie H. King, Revell, 1970.
- Today, Well Lived, edited by William Arthur Ward, Droke, 1971.
Kemp also contributed poems to religious periodicals of various denominations, was a free-lance feature writer for newspapers in Maryland and North Carolina and reviewed books for the Greensboro Daily News, Greensboro, NC.
Kemp spoke about poetry to Contemporary Authors:
"Since poetry moves on the higher levels of power and emotion, it must be the product of a maker of ideas. The truly creative artists of the written word are gifted with the ability to take the common facts and experiences of life and invest them with epic and enduring qualities. Also, since the heart and core of inspirational poetry is a spirit of devotion and reverence, being idealistic in nature, spiritual in quality, and moral at its center, its writer must be constantly aware of the eternal secret of friendship with God. He must also be possessed with what has been termed `religious insight.' He must not let himself be limited to any one nation or people, nor to any one age, for to do so would admit to a partiality. The appeal of inspirational poetry is universal, since universality must be expressed in its writing. Eternal vertities will ever remain the same, regardless of the change made in other things. Inspirational poetry is the true language of the heart. It is composed of emotional feeling, deep and sincere."