Although the
ultimate answer to "Why is this physical theory the way it is?" will always be "Because it works.", we shouldn't give, or be satisfied with, that answer to
every question pertaining to the given theory.
We can do much better than that by identifying the crucial underpinning assumptions of the theory, mandating them as unexplained edicts, and then showing how the rest of the theory can be obtained through a process of deductive reasoning (sometimes rigorous theorem-proving, other times plausible physical arguments).
In the case of Quantum Mechanics, I think a good starting point is to accept that a system is to be modeled by a complex Hilbert Space ##\mathscr{H}##, and that experimental outcomes are to be interpreted as probability distributions. The heart and soul of the prescription is that probabilities are ultimately calculated in terms of expressions of the form ##|\langle \psi | \phi \rangle |^2##, where ##\psi## and ##\phi## are unit vectors in ##\mathscr{H}##.
It is useful to think of the 'bra' ##\langle \psi |## as the simplest possible measurement procedure (or
observable) and the 'ket' ##| \phi \rangle## as the simplest possible preparation procedure (or
state).
The rest of the theory (i.e. this and that type of operator, trace functionals, and all that jazz) emerges from fleshing out this simple prescription into a well-defined and self-consistent probability theory.
Without going into all the details here (you can read my
more detailed explanation here if you're interested), the Hermitian Operators (more correctly Self-Adjoint Operators) are a natural generalization of the 'observable' side of the recipe, which assign real numbers to outcomes while preserving the basic probability calculus. Similarly, Density Operators are a natural way to generalize the 'state' side of the recipe by allowing us to consider 'convex combinations' of states.
When looked at this way we can come up with further ways to generalize the recipe...
From the fact that a self-adjoint operator is equivalent to a Projection-Valued Measure (PVM), for example, we can generalize to things called Positive Operator Valued Measures (POVMs) whilst keeping the probability calculus intact.
In fact, we can generalize in another direction too. We can attach complex numbers to measurement values, instead of real numbers, and the resulting object is a Normal Operator ##N## (which has the form ##N=Ae^{i\Theta}## for self-adjoint operators ##A## and ##\Theta## ).
And on it goes...
The main requirement in Quantum Mechanics is not that measurement values are
real, or that outcomes must be
eigenvalues, or that post-measurement states must be
eigenvectors, or any of those things. They were just part of the historical discovery pathway. Rather the aim of the game is to make sure you have an unambiguous and self-consistent probability calculus which preserves the basic interpretation of ##|\langle \psi | \phi \rangle |^2## as the probability of a simple observable ##\langle \psi |## registering an outcome for the pure state ##| \phi \rangle##.