Is language, information? If it is, then language is a mapping of our experiences between awarness and behavior, that gives a meaning to changes.
There are many ways to exchange information and many languages to accomplish it. By thinking you are remapping experience, in your memory, this is a language in itself.
Thoughts are controlled or influenced by the language we speak, to the extent, of the meaning we put to the words. Thoughts are quantum in nature and not deterministic. Although thought can be controlled to some extent, it is not easy. Two exact thought imputs do not get one and the same result. Just try and type and answer to this post and erase it and try and write exactly the same thing again, the next day.
Thinking without language would be like being without any knowledge.