People don't understand the first amendment. He has the right to say whatever he wants, but that doesn't restrict his employer from severing ties if he says something offensive or ignorant. If just about any person in this thread was at work popping off about black people being better off in segregated times or gay people needing to try some vagina, you'd have HR in your ass within seconds. Obviously this guy wasn't "at work" when he made the comment, but as a public figure for A&E, what he says publicly reflects on them.
Personally I wouldn't have fired him, but I understand why he was fired. What brand wants to be associated with ignorance? I'd argue the show wouldn't lose viewers if he stayed, nor would advertisers leave given the show's popularity. Therefore I'd ride out the storm and make him go everywhere with a damn publicist.