Thanks for your note... and your refereeing...
From what I see on TV that is not what they say... that if a person has a clear path to the goal and is fouled it is a red card.. and this does not include the goal keeper... so I would say that if the goal keeper does it then it definitely should apply...
From FIFA...
Unfairly denying an obvious goal-scoring opportunity
If an outfield player who intentionally blocks a shot to goal with his hands will be punished with a red card. The same punishment is given to a defender who fouls an attacker when there is no other defender between him and the goalkeeper
I am sure there is language somewhere that says it is in the opinion of the referee, but it is listed as one of the red card offenses... and it does say "will" in the language not "may"...