The algorithm I saw involved finding a subprocedure called "House" -- something relating to something called a Householder matrix.
The algorithm for house involved dividing by something positive -- when I naively tried to apply it to a finite field, it required a division by zero.
I think the house algorithm is, given a vector x, supposed to return b and v such that (I - \beta \nu \nu^T) x = ||x|| e_1. The algorithm blew up on the computation of b... I tried assuming it had v right, and found that such a beta cannot exist.
Furthermore, I don't really have a norm on a vector space over a finite field -- many of the interesting vectors have a zero inner product with themselves! So, I strongly suspect that in such cases, even if house could be properly tweaked, I don't know if it would give interesting results at all!