There is a difference between keeping Torah as opposed to being part of the religious world. In fact, there is a kind of fraud in the religious world in that the major effort and drive is to get converts. But the hidden message is that the converts will then be the servants of those that are already religious.
The trouble is that the religious world keeps external rituals, but gains evil character. So trying to get people to join is really not in the category of a good deed.
It might be that the religious think they are righteous. But they are not. They are religious, not righteous.
[ The closest to pure Torah is the Litvak yeshivas, but there the Sitra Achra also has some hold.]
To understand the issue it might be helpful to take note that just simply "being religious" in itself tends to be a problem. It is to easy to get it wrong and fall into fanaticism.
You can understand this based on the idea of Dr Kelley Ross [of the Kant-Friesian school of thought] that there is an array of "value".So the values of knowledge and beauty are not along the same lines as value of attachment with God. But that area of spiritual value --can fall into its opposite. That is the case with every positive value. When it decays it becomes its opposite.
