Fraleigh's A First Course in Abstract Algebra is probably the clearest, easiest textbook introductions to Groups (as well as Rings, Fields, Galois THeory).
Group Theory is very different from other math. Technically, you really don't even need to know Calculus, all you REALLY need is basic arithmetic and algebra. But when people talk about "maturity" they mean the ability to read, understand and do rigorous proofs.
Alot of the "machinery" you do in group theory isn't much more complicated than basic algebraic manipulations, but at this point in your math career you are less interested in "calculating" and are more interested in "proving", "showing" etc. A lot of your basic "knowledge" about algebraic operations that you take for granted, you can't in group theory (and the rest of abstract algebra).
For example:
a*b = b*a is NOT a given (you should actually have seen this in linear algebra where matrices are not, in general commutative under multiplication). So when you prove stuff, you really have to know your theorems and definitions well and do only what those theorems and definitions say you can do, and nothing more.
Again, for the above example, if your proof of some problem NEEDS or SEEMS to need a*b = b*a, then you have to be sure that your algebraic structure guarantees that (it may not).
Group theory is often the hardest class a math major will take, not because DOING it is hard, but rather most people just are NOT used to THINKING about math in this way (most people have a ton of calculation experience and maybe a smidgen of proof experience).
Some courses that may prepare you for the type of thinking involved in Group Theory: Elementary Number Theory, junior level Linear Algebra, Modern Geometry. Those are given in level of difficulty (in my opinion) from Hardest to Easiest. What these course can provide is a "nicer" introduction to rigorous proofs and abstract thinking. They deal with structures and operations you probably have seen before, but now you develop it rigorously (same with abstract algebra, basic elementary algebra is derived from abstract algebra, but group theory tends to go off into areas of algebra you have definitely never seen before).
TO make a long story, still long: Group Theory can be very hard and frustrating at first, it'll probably require a lot time effort and a lot of hair being ripped out of your head; but if you work at it, give it a serious effort and (and this is VERY IMPORTANT) as for HELP from your Prof or TA, then you can do just fine. Its not impossible, just different. Go into it knowing its going to be something very different from Calc, Elementary Linear Algebra, Trig, etc...and go into it willing to learn this new type of thinking.
I can guarantee you that a semester or two of abstract algebra will make you into a much much better mathematician.