Such things are useful, that's why we create them. They are how we organize our thinking and as science thinking gets more complex, we create new ideas so we can talk about them more easily. Yes, by redefining existence, we can make all kinds of things "appear" and "disappear" from reality. Numbers and mathematics do exist in our minds, isn't that sufficient? What is gained by having them somehow exist outside of us?