Not only that, but you can't use certain moves outside of battle until you have the right badge. It can go either way, stuck in the game or an actual world by itself.

[Which are distinctively different.]

And you're not the only one. There's a fair number of us who played the games and generally mention it when they first arrived.