I'd argue that magic does have grounding in our world. Sure, we understand today (at leady most of us) that it isn't real. For most of our history people have believed magic was real though, and attributed real events to magic. We have the word because it has a long history of people thinking it exists. If a story wanted to use "magic" to explain events, that'd be pretty realistic to the times it's taking place in.