The usual Canadian tax complainer is a fellow who makes over a hundred grand a year, has a stay-at-home wife, a bunch of kids, and a fat mortgage payment. The hundred grand puts him in the top bracket (39% where you are but as high as 50% elsewhere in the country) with no deductions for wife, kids, mortgage interest, or provincial taxes.
Even at fifty grand, your tax bill in any province is going to be at least ten grand. In the US, you start with 50, deduct 15 as personal exemptions, 10 as mortgage interest, 5 as property tax, and are left with a taxable income of about $20k. I don't have Pub 17 in front of me but you can't pay more than a couple of thou on that in the US.
To be fair, the income tax difference never gets worse than about $10k and, for most people, it's a lot less. Toss in cheaper houses, lower property taxes, never having to worry about medical insurance - even if you do have to worry about medical care - and it's close to a wash.
But, shhhh, don't tell anyone. You'll ruin it for all of us.