“… any statistical procedure should possess the following desirable features:
(1) It should have a reasonably good (optimal or nearly optimal) efficiency at the assumed model
(2) It should be robust in the sense that small deviations from the model as- sumptions should impair the performance only slightly….
(3) Somewhat larger deviations from the model should not cause a catastrophe.”
A quote from Huber as quoted in Casella & Berger.
I love the use of catastrophe in this quote.
Huber, P. J. (1981). Robust Statistics. New York: Wiley.