Loyalty to Torah ought not be confused with affiliation to the religious world.  Even the most straight of all groups, the Lithuanian world of Torah is, after all, only human. You can see this principle in the Torah itself where the emphasis is on loyalty to God and keeping his law. but also [as i have mentioned many times] you see this in the Gemara which deals with the sacrifice that klal Israel brings when we listen to a mistaken Sanhedrin. [The case is when the Sanhedrin rules on a situation which involves the penalty of karet (cutting off) [e.g. idolatry , or shabat] and the Sanhedrin rules that some act of idolatry is permitted when the individual knows it is forbidden. still the individual depends on the ruling of the Sanhedrin and does the act. he has to bring his own sin offering and can not depend on the sin offering that the Sanhedrin must ring for their own acting on their mistaken ruling.]

There is no concept that the religious authorities can not be mistaken. So then what about the statement אפילו אומר לך על ימין שמאל או על שמאל ימין even if he says on right that it is left or on left that it is right this does does not refer to a case where the law is known to the individual as we see in the gemara that one must not depend on a mistaken Sanhedrin.