So you couldn't take it from there.
The Bill of Rights incorporates into law rights Americans largely assumed for themselves in the Colonial period but were little protected in law. The Constitution by itself did not protect them since it left the law it did not cover to the Common Law, i.e., the fluid court made law developed over centuries by English and Colonial courts, law which by definition made no lasting guarantees regarding civil liberties. At any time legislatures in the new states might enact laws suppressing the rights of speech, to bear arms, etc. This protection was the purpose of the Bill of Rights. Madison never dismissed the Bill of Rights as "dumb". He did initially favor a clause in The Constitution giving Congress veto power over state laws, a much weaker protection clearly in view of the political hackery that has replaced statesmanship in the affairs of government since Madison's time.