Smooch,
ML may be correct, I'm not sure what you bought so you'll have to do your own DD.
If the money is in tax deferred accounts I would pay the back end charges and move the money. Just make sure they don't send the check to you. It should go directly into a tax deferred account at Vanguard.
If it's a taxable account I would look at the total amount of fees and taxes and make a choice based on that info. That's a choice only you can make. If you can live with the fees and taxes I would just sell and get your monies in Vanguard ASAP and don't look back.
All of my money is now at Vanguard and some of it is still in Oppenheimer funds, but only the taxable accounts. I will have to do some DD and figure out if it pays to just get out or wait until I'm retired and in a lower tax bracket.
In the end you will feel better once it's all moved over.
Good luck