There is some cultist aspect to the religious world. This is even though as far as possible to tell, all they are doing is trying to follow Torah. Still there is a definite aspect of the Sitra Achra [Dark Side] that has taken hold of the religious world. It is almost as if there is a "for the sake of money" or other aspects there. While that is true, still it does not explain the issue. At any rate , in spite of the frum (religious world) making a song and dance of how they alone keep Torah (and so everyone ought to give them money), still there is some reason to avoid them if you value your family and life. For there is a aspect of the Dark Side that has taken hold of the religious world.
The problem is obviously that Torah is positive value and the most positive value. So זה לעומת זה עשה האלהים [the good side and evil side are parallel.] for every positive value there is a whole circle of negative value surrounding it. So what is going on is that the Dark Side is buried deep inside the religious world.