I think most people who use it are considering just the straight numbers. If there actually were something resembling an objective measure of beauty, then a population would fall into a bell curve. But I don't see people in casual conversation thinking that way.