The person that proved Fermat's last theorem [Wiles] gave a talk [published in Quanta Magazine] in which he claimed everyone can learn Mathematics. The way that I see this as possible is by the path of learning of Rav Nahman by saying the words and going on. [People are accustomed to this in Torah learning where it takes a lot or review until you understand. So people do not usually expect to understand the sugia (subject) at first. They simply say the words, and come back to it. I understood that the way one gets the idea after lots of review. I see this as applicable in Mathematics also. "Say the words and go on. Even if you do not understand at first , you will eventually understand. And if a few things remain hard to grasp, well so what? for the greatness of lots of learning goes above everything. [Conversations of Rav Nahman paragraph 76.]]
[But why learn Mathematics--you surely will ask. For me the answer is simple. My father encouraged my interests in Mathematics and Physics. So while I did no understand nor understand at present why this is important, I have the obligation of כבוד אב ואם Honor of one's father and mother. And Confucius said the very fact that you are not walking on the path of your parents means (by the very definition of that term) that you are not honoring you father and mother. [It does not matter if they said to do so.
But for others that have not had parents that encouraged this let me mention some of the Rishonim that held from this. One would be the Gra who said any lack of knowledge in any of the Seven Wisdoms creates a lack of Torah knowledge times 100. [That is the quotation in the Intro to Euclid in Hebrew by a disciple of the Gra.] Other Rishonim would be Ibn Pakuda, Binyamin the doctor and the Rambam.