I actually had no knowledge of plenoptics or 4 or 5d representations of light http://en.wikipedia.org/wiki/4D_light_field#The_4D_light_field
before I made this post. But it seems like, for a lensless camera to work, it would have to be able to measure, or infer the 5D characteristics of each...