"Some of the people in my caucus, some of the people in the state party in Minnesota have basically said, "We don't want to deal with these guys because they're too conservative," or "We don't agree with them on social issues.""