Claims a historic building was sold from under the noses of a Far North community group have been rebuffed by Labor, with calls to rejuvenate a beloved town square emerging as a key election issue.