Too often many who withdraw from the faith does so on the common ground of church or individual error. The church's or other individual Christians' behavior is usually the culprit for their falling away from faith in Jesus Christ. Withdrawing from Christ due to the error/s of others is a manifestation of speculative faith. Clearly, Jesus was never the foundation of their faith; otherwise they would not have allowed the behavior of other Christians to influence their decisions to stop following Jesus. Ostensibly, these "pseudo-saved" people never transformed from discipleship to friendship and probably were never taught to "work out your own salvation". (Phil 2:12).
One's faith in Christ should not be contingent upon what others believe but on the words of the Lord. Jesus never told anyone to believe in humans although He appointed humans (earthly beings) to do a heavenly work here on earth under the direction of the Holy Spirit. Yet, He only told us "you believe in God, believe also in me".
Further, He stated that "by my words you will be judged". The Lord's word is a manifestation of His will. In fact, He said that "my food is to do the will of Him who sent me and to finish His work". In essence, He gave precedence to the fulfillment of the word of God over everything else. With that said, I caution you brethren to work out your own salvation and walk in obedience to God's word. Pinning your disobedient actions on others does not provide an escape route from His judgment. I therefore encourage you to develop a deeper relationship with your savior - Jesus. You do not need a high priest to enter the holy of holies for you anymore. You have access by His Spirit so go and hear from your Father for yourself.