No, not all the Founding Fathers owned slaves. However, most of the Southern Founding Fathers did own slaves, including George Washington, Thomas Jefferson, James Monroe, James Madison, Patrick Henry and George Mason. Although he was from Pennsylvania, Benjamin Franklin did own a few slaves during most of his adult life.