There are different ways of defining and introducing e, but when you're new to logarithms, I think the easiest way is to define e as that number for which:
\frac{d}{dx}e^x=e^x.
More detail:
\frac{d}{dx}a^x=\lim_{h \to 0} \frac{a^{x+h}-a^x}{h}=a^x\lim_{h \to 0}\frac{a^h-1}{h}
You can check the limit exists (for a>0 ofcourse). Also, if f(x)=a^x, then you can see that f'(x)=a^xf'(0)
If you try some values for a and some small values for h to get some sight as to the value of the limit :
If a=2, then the limit is approx. 0.6934
If a=3, then the limit is approx. 1.0986
The larger a, the larger the limit. There exists some number between 2 and 3 for which is value is 1. You can define that number to be e.
So e is that number for which:
\lim_{h \to 0}\frac{e^h-1}{h}=1
Therefore you have this nice rule when differentiating e^x:
\frac{d}{dx}e^x=e^x
and this is actually one of the main reasons it is used so often.
Likewise, differentiating \log_a x gives \frac{1}{x \ln a}, so if you use base e (the natural logarithm) the derivative is simplified.
The above hopefully gives some insight into e. It's important to understand where it comes from and why it is used so much. After that, memorizing the derivatives and such is trivial.