Mossman residents fear the rural town will not survive the sugar mill closing with businesses already reporting a significant decline in trade.