If you want to go back to the mid-1500's, I'll probably still be right, but there was a lot of non-church activity done in the name of the church, even though it was counter to the theology.
Before that, much simply needs to be attributed to the evil inherent in our nature rather than religion.