I guess by “on-site energy”, you mean “internal energy”?
As stress increases, the strain increases, and energy is stored in the elastic material.
There is a yield point, where the stress is partially relieved by plastic deformation.
If the stress is then removed the elastic strain will be reduced, but there will be some energy remaining in plastic strain where adjacent grains in the material have undergone different plastic deformation.
“Work hardening” is associated with remaining internal energy.
https://en.wikipedia.org/wiki/Work_hardening
“Annealing” can relieve the remaining internal energy.
The internal energy that remains will depend on the state of the grains within the material.
What is that material and what do you know about the internal grain structure?