The Dirac delta "function" is a way of expressing point-like objects in continuous space. For example, let ##\rho(x,y,z)## be the charge density in some region of space. For a macroscopic object, we can usually average over the fine details, and express ##\rho## as some smooth function. But at a microscopic scale, matter is made up of point-like objects. Let's forget about quantum uncertainty for a moment and imagine there is an electron at ##(0,0,0)##. The charge is ##-e##, but how do you express the charge density, which is a function over space? The charge density is zero everywhere except at ##(0,0,0)##, where it blows up. You can't write this kind of distribution as a normal function.
Now, if the electron has a finite size, you could write down a function with a small region where the charge density is nonzero. For example, if you assume an electron is a uniform ball with radius r, then the charge density would be ##\frac{-3e}{(4\pi r^3)}## inside the ball and ##0## outside.
You get a 3D version of a Dirac delta function if you change the radius of the ball to 0. (Basically you get ##\delta(x) \delta(y) \delta(z)##, which is frequently written ##\delta^3(\mathbf{r})##.) Note that the shape is unimportant when you change the radius to 0. You can start with a Gaussian distribution and change the width to 0, or a cube and change the length, width, and height to 0, and you still get the same Dirac delta functions, since shape is irrelevant for a point.