Considering he actively avoided apologizing for his Rectorship afterwards, I'd say he probably didn't think about that question enough.
But in his defense, Heidegger's conception of the Nazi party was a small group of warrior poets who dwelled in the Black Forest and recited Holderlin. That's a party I think we can all get behind.