Information represents some kind of order in a system (like the arrangement of atoms, the modes of the strings in a subatomic particle, the position of planets, the mapping of a gravity field, words on a piece of paper)
In thermodynamics, the internal entropy of a system decreases as the system becomes more ordered and thus more information emerges. This means that the entropy outside of the system had to increase by AT LEAST that magnitude. This means that the net entropy always increases (at least as far as our universe is concerned as well as our current understanding of things).
Energy is the difference between two states. So for objects to become more (or less) ordered--increasing/decreasing information, energy has to be transferred. Remember: energy is the quantity of action and it is relative difference between two states.
Energy can be heat, kinetic energy of a moving mass, or even something without "kg" or "m" or "s" in its units. It is up to the investigator to decide what the units of energy are given some framework with objects and states. For example, in string theory, "kg" does not make sense in the units of energy because the notion of "mass" no longer applies. Conventional mass is a macroscopic property and is hidden from string theory. Energy needs to be redefined perhaps with units 1/s (frequency) or some other units.