I had the same issue a while ago when I installed a new graphics card.
At first, my computer acted like yours except that it kept restarting (instantly) over and over.
My power supply was too weak.
After upgrading the power supply my computer acted exactly like yours.
I then proceeded...