I'm actually less worried about a stolen credit card number than identity theft. I've had someone use a credit card number of mine before for a rather grandiose vacation in France (or at least the price tag was grandiose). The credit card company flagged the charges and deactivated the card before I even knew there was a problem yet (I found out when I called to find out why my card wasn't working). Of course, since all the charges were in a foreign country, it was easy to prove it wasn't me, but they never even required I prove it since it was clearly a huge deviation from my usual spending patterns. I just had to fill out a bunch of paperwork, and it took a few months to catch all the charges as they trickled in, then reverse the interest fees that automatically added on when I didn't pay those charges, but they were always easy to work with and I just needed to make one call each month when each new statement came into inform them of the charges that were still appearing, etc.
Since I have very regular spending patterns, it's easy to flag unusual activity on my accounts.