It doesn't have to do with "the fallible nature of observations by light". It's simply not considered possible to observe beyond the event horizon.
It also doesn't have to be "from the point of a distant observer". Any observer outside the event horizon will do just fine, no matter how close. That means all observers that exist for us.