Bible Verses About leaving church

And I say also unto thee, That thou art Peter, and upon this rock I will build my church; and the gates of hell shall not prevail against it.

Now I beseech you, brethren, mark them which cause divisions and offences contrary to the doctrine which ye have learned; and avoid them.

Which is not another; but there be some that trouble you, and would pervert the gospel of Christ.

Having a form of godliness, but denying the power thereof: from such turn away.