A controversial entertainment precinct in Byron Bay has moved a step closer despite community fears it could turn the already popular coastal town into a “party destination”.