"There's never going to be a time where the Republican Party rallies around and says you have to get out or anyone has to get out for purposes of rallying around Donald Trump."