There is quite a gulf between the concepts of rejecting church and fearing no consequences.
The vast majority of the consequences felt in our lives have everything to do with the church - even if the church isn't directly involved. The church is the basis for our moral values, and our laws.