Andrew Constance said "Labor will be rubbing their little hands together" over John Barilaro's attack on him which torpedoed byelection plans.