Artificial intelligence mathematics

Geranimo
Messages
19
Reaction score
2
Hello, I'm currently in a physics/CS undergrad program and I would like to continue to graduate level in artificial intelligence. But recently I started to browse artificial intelligence papers and discovered that they are very mathematical. I ask myself if I should switch to maths/CS undergrad program.

Do you think a physics/CS undergrad degree is mathematical enough to enter grad level AI?
 
on Phys.org
IMO, you'll learn the math needed in the CS portion of your program, provided you take the relevant courses. But you can always learn on your own, too. Try reading Artificial Intelligence: A Modern Approach by Russell and Norvig. It includes an appendix with a review of the mathematical background needed for studying AI.
 
  • Like
Likes   Reactions: Geranimo
The mathematical tools presented in the book are analysis of algorithms, asymptotic analysis, complexity analysis, linear algebra and statistics. I suppose this is the core of it. Do you have suggestion of courses I should follow for analysis of algorithms, asymptotic analysis and complexity analysis?

Also, if there are any other maths fields I should be familiar with, what would they be?
 
Well, aside from the subjects you mentioned, you should also be familiar with fuzzy logic and stochastic processes. There's also a textbook called Mathematical Methods in Artificial Intelligence by Bender, which should be a nice complement to AIMA.
 
  • Like
Likes   Reactions: Geranimo
There is only mathematic behind IA, i think you should have a solid mathematical background but computer science is essential too. I think you need to keep your ia graduation.
 
For AI, math is better than physics. Especially optimization and probability/statistics. If it will not set you back too much, you should switch. If it would set you back too much, get the degree and start reading those subjects (also neural networks).

PS. There are many AI applications where knowledge of physics is a plus, so don't despair.
 
  • Like
Likes   Reactions: Geranimo
The mathematics needed for analysis of algorithms is usually thought in courses/books on the subject (perhaps assuming knowledge from a basic discrete math course/book).

AI is a big field and you'll have to eventually specialize at some point in your graduate education. Speaking for the more machine learning-related areas:

Probability and statistics is a must. More advanced books (e.g. Statistical Learning Theory by Vapnik) and research may use phrases terminology relating to measure theory, but it is probably overkill to learn probability and statistics at that level of detail (likely graduate course) unless you're convinced you want to do work in that area (or are very curious). Calculus would be involved here, but you'll get that either way with math or physics majors. Learning something about Bayesian statistics may also prove useful.

Linear algebra is a must. Typically taught as two courses in undergrad; one more concrete (and probably only finite vector spaces) and the other more focused on abstract matters. The first should be sufficient. But going further can be useful, e.g. kernel methods in machine learning deal with transformations to infinite vector spaces (reproducing kernel Hilbert spaces, in particular).

Numerical optimization is very useful. Maybe you don't need a course and can get away with just studying specific methods as you encounter them in your AI studies. I haven't take a course (I got through my work trying different variants of Newton's method or gradient descent), but I always feel like I should know more about the area in order to improve the performance of my learning algorithm implementations. I've started to watch Boyd's Stanford course on convex optimization to understand this area more. Prereqs are calculus and linear algebra (and probability/statistics for data fitting examples). They use a bunch of terminology for analysis, but claim that studying real analysis isn't necessary for their course (but if you do plan on learning measure theory for probability, then you'll have to be studying real analysis to build up to that!).

Anyway, those are my thoughts from what I've experience studying machine learning in graduate school. Obviously experiences will be different in different areas of AI and what projects you end up working on. My graduate work involved kernel methods and Bayesian statistics, so I used all of the above. If you study say, I don't know, fuzzy logic systems, then probably you need to learn different/additional math. I did take enough math courses as an undergrad CS student to get a minor, but don't let that deter you from physics. I think you'll be learning all of the above, maybe except for optimization, in physics. Perhaps not as formally as you would in math, but that's probably okay.
 
  • Like
Likes   Reactions: Geranimo

Similar threads

  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 77 ·
3
Replies
77
Views
8K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 26 ·
Replies
26
Views
4K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 21 ·
Replies
21
Views
5K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 3 ·
Replies
3
Views
5K
Replies
4
Views
4K
  • · Replies 25 ·
Replies
25
Views
2K