Also, when AD-BC=0 as the case above, then we really have no eigenvalues to determine its behavior.
Yes you do.
Let's look at this one again:
x' = -2x + 4y
y' = x - 2y
a.k.a.
x' = A
x with
A := \left(<br />
\begin{array}{cc}<br />
-2 & 4 \\<br />
1 & -2<br />
\end{array}<br />
\right)<br />
We compute the characteristic equation of A:
f(\lambda) = \left|<br />
\begin{array}{cc}<br />
\lambda + 2 & -4 \\<br />
-1 & \lambda + 2<br />
\end{array}<br />
\right|<br />
= (\lambda + 2)^2 - 4 = \lambda^2 + 4\lambda = \lambda(\lambda + 4)<br />
so its two eigenvalues are 0 and -4.
The eigenvector associated to -4 is [2, -1]^T
The eigenvector associated to 0 is [2, 1]^T
So the general solution should be, I suppose,
x = A exp(0 t) [2, 1]^T + B exp(-4 t) [2, -1]^T
x = A [2, 1]^T + B exp(-4 t) [2, -1]^T
This looks right, I think. We recover the translational symmetry observed in the solutions.
Of course, that first base solution is unsatisfying.

But it comes from an assumption I made in setting up the problem... I assumed that in order for the ODE to be zero, that I had to pick x' and y' cleverly so that the two terms canceled out. But, I have another option: I can pick x and y cleverly so that both terms are zero!
Because I tried to pick x' and y' cleverly they both zero out at this particular solution, which means that when I try to take "infinitessimal steps" of size [x', y']^T, I'm not going anywhere. But, now that I've spotted the problem, I can just take the solution for x and y that work, and I've already figured that out from the eigenvector:
[x, y] = t [2, 1]
But I can easily read it off of the equation too, by factoring:
(2x - 4y) y' + (x - 2y) x' = (x - 2y) (2y' + x')
So I just need x - 2y = 0, or y = (1/2) x.
Note that the original equation is not linear, so we cannot just add this to the previously determined solution!
Working it out, we have two families:
[x, y] = (At + B) [2, 1]
and
[x, y] = B [2, 1] + C exp(-4 t) [2, -1]
(Because if you plug in, you discover that AC must be zero)
Stupid
quadratic equations.
(You notice that the equation is of the form x^T M dx = 0 for some matrix M?)