I believe the earliest source found on this quote (maybe only one) was in a letter from Newton to Hooke acknowledging some credit for the progress he had made in math and science. Yes, Hooke was what we might describe as a Little Napoleon, both in size and personality (not that Newton was any walk in the park either).
It wasn’t long after that Hooke started publicly complaining that the early drafts of Principia didn’t give him proper credit. Newton then removed Hooke’s name from later parts of the book before publishing, and worked to avoid giving Hooke any credit at all in any area.
In addition, Newton avoided publishing Optics, until the year after Hooke died; an area of science Hooke was considered as an expert.
Newton did not like criticism and he did not like Hooke.