Blah, I just had a long reply eaten. Paraphrasing quickly
How you actually derive the supergravity action is usually done by linearizing and working algebraically, as opposed to using the superfield formalism (although it can be done).
However once you actually have found it, you can simply take the sugra action at face value and nothing needs to be linearized a priori, it just turns out that it is convenient for some purposes.
Further, the gravitational part of the SUGRA action is remarkably similar to the usual GR action. The subtleties is that instead of having only one metric field at play, here you have a Veirbein, and a gravitino field (+ maybe an auxiliary field if you don't want to use the eom). The curvature R is also calculated with a spin connection (since we have fermions in the theory).
Anyway, what you want to show is how to get pure GR from this action. Well the problem really is how you go about breaking supersymmetry, since that is an unknown mechanism.
I don't know of a reference where its calculated explicitly (there is no obvious Inonu-Wigner like contraction method that is possible afaik), but you can handwave a lot of it through yourself by simply brute force taking the effective field theory after integrating out all the heavy d.o.f.