Yeah, I don't know if annihilators are applicable when you have nonconstant coefficients. What you started out with is called variation of parameters or, in some books, variation of constants.
I followed that through and came up with the solutions.
Given that y = t-1 is a solution, you're looking for a solution of the form y = vt-1. Differentiating that twice and substituting into the original equation gets you to this equation:
-v' + 2v''t = 0, or equivalently, 2tv'' - v' = 0 (a lot of terms drop out)
Let u = v', so u' = v''
The last equation a couple of lines up becomes 2tu' - u = 0, or
du/dt = u/(2t)
Separating, we get du/u = (1/2) dt/t ==> ln u = (1/2) ln t = ln (t1/2)
So u = eln(t1/2) = t1/2
Backing out, since u = v', then we integrate u to get v: v = (2/3)t3/2
I'm being very cavalier about the constants of integration. In the end, we'll work it back in.
One more step. We have y = (1/t)v, so y = (1/t)(2/3)t3/2 = (2/3)t1/2.
The 2/3 factor can be discarded. All I needed was to find another linearly independent function to go with y1 = 1/t. The other is y2 = t1/2.
The general solution to the original DE is y = C1t-1 + C2t1/2
. As you see, the constants I ignored earlier are back in.
An alternate approach is to assume that solutions are of the form y = tr. Then y' = rtr -1 and r'' = r(r - 1)tr - 2
Substitute y, y', y'' into the original DE to get 2t2r(r - 1)tr -2 + 3trtr - 1 - tr = 0
Multiplying things out and collecting terms by powers of r, get get
(2r2 - r - 1)tr = 0
The quadratic can be factored to give r = -1 and r = 1/2, which is in agreement with the previous work.
The type of DE in this problem where you have decreasing powers of the independent variable as the orders of the derivatives decrease, has a name. I think this might be called an Euler equation or maybe an Airy equation. Without checking, I don't know for sure.