Town councilors say the building permit allotments allowed in the draft plan to revise the town’s growth management ordinance may be too high.