If traveling "with a backpack" is already boring, rent a car to explore the historic sites of Culpeper. You can get a car at one of the rental companies' offices: East, etc. You will immediately understand the difference: seeing the planned attractions will be several times faster, and traveling around Culpeper is much more pleasant.