Heritage now bows out of the activist right conference because of the tiny gay group officially allowed to attend.