Actually, it's not the building that makes it sacred either. The land is blessed before the building even goes up. Graveyards have the same blessing, as do some other places. In fact, some jails even have sacred ground because the religions at the town deemed that it was needed to keep the devil away from the souls inside.