I was idly wondering about this. An anime convention, PopCon, came through July 7 through 10th. I wasn't attending, but I followed some cosplayers from the Circle Center Mall into the convention center and strolled around. PopCon is much much smaller than GenCon (it was using maybe 1/10 of the convention center, and a different event was being held on the other side). I wandered in and mingled a little. But there were people outside the actual exhibit halls who seemed to be checking badges at the doors, so I couldn't go in that deep.
The convention center is an open and sprawling building. I go in sometimes when there's no events at all. I think it's generally a pretty public place. Otherwise, they'd have to have badge checks at the entrances.