In the book (Nefesh Hachaim by Rav Haim of Voloshin) of the disciple of the Gra we find [volume 4] the importance of learning Torah. He brings this from many statements of the Chazal [Sages]. So the idea you find in the Litvak yeshiva world about the prime importance of learning Torah is not made up or pulled out of a hat. It is a basic axiom of the Sages.
The only thing in which I differ is Mathematics and Physics which you find are thought to be part of the commandment of learning Torah in some rishonim. Mainly Ibn Pakuda and the Rambam but hints to this opinion exist in other rishonim as well.
The in Guide for the Perplexed you find the Rambam saying that the work of the Divine Chariot and the Work of Creation are the subjects that the Greeks called Physics and Metaphysics. [He repeats this same idea in the Mishna Torah--so it is not just something he decided towards the end of his life.]
[Not that I can do any learning myself anymore. So I figure even if I can not do what is best and good, why should I not want my friend to know and do what is right? And who knows if perhaps someday God may grant to me to get back to learning?]