If you can come up with an alternate answer (one that does not violate the laws of physics) please feel free. There is only one way that a stalagmite-type extension can form on an ice cube. There could be a number of causes for the dripping, but the method of formation (deposition of liquid water from above and freezing into a column) is not negotiable.
They are not stalagmites. Just because it walks like a duck doesn't mean it's a duck!
They are called Ice Spikes. They are formed as the top layer of water freezes over, leaving a smaller and smaller hole. The expansion of freezing water below this thin layer of ice causes water to bulge up through the hole, where it freezes in a ring.
Physically, if they can be compared to anything, they are more akin to deep sea volcanic vents.