That is just one problem. They might invite you into their kollel if they think you can give them money but never to be part of their group. It is a kind of גניבת דעת trickery.
But the further problem is that the frum world itself is clearly insane. That is it is filled with insane groups and the likelihood is anyone joining in will join in one of those groups.