Thank you for all of the responses. I've gained quite a bit of insight how to deal with this.
Let me explain one huge advantage to stealth wealth. People never come to us asking for money, proposing a contribution/investment in a small venture, asking for charitable contributions for some cause we don't care about or just the expectation that we should share our money with others inferring that if we don't share it we are somehow stingy or worse.
Because of this we never have to say no.
I, for one, am very resentful when put into this position. When I had a pickup truck I could not believe how many "friends" came out of the woodwork asking to "borrow" my truck and I really resented telling them no because it put an unfair obligation on me to say no through no fault of my own and the person asking generally had no clue what harm they were doing by asking. My truck at the time was what some called a monster truck with lift kit, engine mods, heavy duty differentials and transfer case and jumbo tires and wheels. It had a bed and people got the idea it was like the F150 at for dealer or something. I used it for off-road, driving to the mountains in the snow and for rugged use only but it was also useful for moving furniture and garden supplies but only because I had a trailer and receiver hitch that was lowered.
That said, for a number of years I would get these friendly calls and I would tell them that I sold the truck and no longer I had it and they would terminate the conversation at that point.
We have friends who flaunt their meager wealth and they too, complain about people always asking for handouts, for money, for investments, etc. It is just a pain to say no to people. When I have to do it I feel a mix or anger, annoyance and incredulity. I would rather not deal with saying no to people. I don't like doing it. My wife, on the other hand, cannot even say no to people, she just isn't wired that way. She says, "Talk to him" and then I have to be the one saying no.
We don't mind paying for group meals but only when it is our choice. We don't mind contributing to good causes but again, when it is our choice. Human nature, being what it is, creates this sort of situation.