1) $250,406 has given me $1,639 in dividends over a 5 month period. The fees for this portion is about $3,200 dollars for this year.
That's 1.28% over 5 months, which projects out to 3% for the year if the rate holds. The fees on the other parts seem less but I'm not clear what the fee structure is. Sounds like a base fee + fees on transactions, and that one group has a lot of churn.
It's up to the OP to do whatever s/he wants. The building isn't on fire, but the septic tank is definitely overflowing. Index funds aren't the only answer though it is a good one.
In my opinion the first mistake the OP is making is looking at dividends only, rather than total return. Compare $100K that does not grow in value and generates 4% income that you pull out, against $100K that grows 3% and generates 2% income. In the latter case you can pull out the 2% income and 2% of the gains to get the same 4% spending money, but now you have $101K. That will actually generate a bit more income the next year and/or leave you more to draw down.
The second mistake is putting up with those high fees. The OP asked for our opinion on this, specifically the fees, and again my advice is to definitely change this. You say you trust the FA and he has not steered you wrong, but what do you base this on? With all that apparent fee-generating churn and mediocre results I think your trust may be misplaced. I'm sure he can cut the fees by churning less but I still think you can do better on your own. Even if you don't have enough to get a free analysis and recommendation from Vanguard, the one time fee for it would still be worthwhile, and you might be able to negotiate to get it for free for transferring your account to them.
I think people sometimes stick with an FA because they don't want to admit making a mistake for so many years, but you can't change the past. You can, however, improve the future. You owe the FA no loyalty whatsoever. But it's no skin off my back if you decide to stay with him.