James Madison, fourth president and father of the Constitution, was not religious in any conventional sense. "Religious bondage shackles and debilitates the mind and unfits it for every noble enterprise."
"During almost fifteen centuries has the legal establishment of Christianity been on trial. What have been its fruits? More or less in all places, pride and indolence in the Clergy, ignorance and servility in the laity, in both, superstition, bigotry and persecution."
From:
The Madisons by Virginia Moore, P. 43 (1979, McGraw-Hill Co. New York, NY) quoting a letter by JM to William Bradford April 1, 1774, and James Madison, A Biography in his Own Words, edited by Joseph Gardner, p. 93, (1974, Newsweek, New York, NY) Quoting Memorial and Remonstrance against Religious Assessments by JM, June 1785.