What kind of mathematics do I need to know to understand virtual reality very well?

Question

In my life I want to develop the virtual reality industry and I wanted to know what kind of mathematics will help me get there, I'm sure that every mathematical subject is helpful, but I mean specifically.

Thanks :)

Answer 1

I am currently in computer graphics course at my uni. The mathematics we need is mostly linear algebra on a rather computational level. You need linear algebra to describe e.g. points, vectors, transformations (matrices) in three dimensions.

Further, some knowledge in calculus/analysis is helpful. For example, we learnt about graphic filters (e.g. gaussian blur filters) which use convolution. Also, we discussed Bezier curves and other parametric descriptions.

Also, knowledge in probability theory might be useful. We used the Monte-Carlo integration method to compute some multi-dimensional integrals.

Answer 2

If you want to program then Logic.

Anyway Linear Algebra will be useful (but just vectors, rotations of vectors and simple matrix transformations rules). The term Quaternion that appears in Unity3D hints just to that.

Answer 3

While I agree with the importance of Linear Algebra, calculus/analysis, and probability, in order to make really groundbreaking improvements Virtual Reality at this stage, depending on your interests, there is a wide variety of subjects you may want to look into.

For example, augmented reality is becoming a very exciting field related to virtual reality. Jobs in this field typically require a PhD in computer vision (CV). A lot of CV is related to signal processing, both discrete and continuous, and some numerical methods to solve PDEs and stuff. Now, however, it is all really machine learning, so for augmented reality, you would want to look into Numerical Analysis, PDEs, Statistics, and some machine learning stuff (maybe neural networks?).

In terms of graphics, the above list would probably also help you to develop new shading models, and meshing techniques.

For 3D reconstruction computer vision is really what you need.

There is also a lot needed in terms of developing the auditory and haptic feedback for virtual reality. This would probably also lead you to a signal processing kind of background.

One last thing that I think would be cool for VR would be an easy way to import real world objects into the VR. This would lead you towards 3D scanning, which is also related to CV.