How to handle those who leave your church. Teach a series of Bible Studies on Wednesday night on how to handle this before it happens. Write a letter thanking them for their years of service. Let them bond with their new pastor and church. If they cause trouble talk to their new pastor. Always get permission from their new pastor if they call you for advice. Pray for them. Hope for their return. Leave the door open for their return.