Two observations.
The first is that if "rich" (however defined) is relative to people you know, where you live and what you aspire to, you can feel richer simply by moving to an area where the cost of living is lower, socialising only with people who are poorer and lowering your aspirations.
Second, given the volume of "bash the rich" talk in the media (including comments on internet sites), concerns over rising inflation and economic uncertainty, it is little wonder that those who I call the marginal rich (most of the lesser HNWIs or low single digit millionaires) are feeling a bit paranoid about the impact of increased taxes on their incomes and properties, inflation on their expenses and economic adversity on their businesses, investments and jobs. The marginal rich may be rich by most measures and compared to most people, but, unless they are more frugal than most, they are not rich enough to be assured of maintaining their wealth (and, by implication, their standard of living) in the future.
IMHO, it is both reasonable and rational not to feel rich until you have enough to be confident that your assets are sufficient to maintain your desired standard of living indefinitely against all (or at least most) forseable forms of adversity. Given the amount of income (or SWR) you can expect from a portfolio of US$1MM, it's very understandable that many people with net worth of around that number would not feel rich.