The context is that it must be an interesting question? How many students are taught that, and how would they know when to apply it?
No, of course you mean that the context is probability questions set in courses, but if that's your defence then the syllabus had better include learning this arcane usage.
I don't accept any of that as excusing the problem setter. It is a practice that has become accepted through custom, but it creates an unnecessary hurdle for every generation of students that has nothing to do with testing their understanding of probability.
An Australian HSC question about 15 years ago set the classic question about two balls, one of which was red. It framed it as Joe having the two balls behind his back, drawn from four red and four black say, but dropped one, and that was seen to be red. Clearly this framing doesn't work. Identifying a specific ball as red means the other ball has a probability 3/7 of being red, not the 3/11 that was marked correct. This customary usage is so pernicious it even catches out exam setters.
No, that's my complaint: the problem setter mixes two cultures by adopting a conversational style.
For a mathematical context there's mathematical style, something like "the set of numbers shown by the dice includes 2". A conversational style is OK, but it is up to the question setter ensure that no ambiguity arises.
Interestingly, in writing my previous post I came to realize that even saying "at least one" does not really solve it. Consider the example I gave about meeting Albert and his little girl:
you might report back to your partner that "Albert has two children. At least one of them is a girl".
Your partner cannot estimate the probability that the other is also a girl without knowing how you knew that - did you see both children or only one? Or did Albert say something that implied one was a girl, and if so what?