Breyer says expanding Supreme Court could erode trust, proponents should ‘think long and hard’