I'm glad I decided not to drop our home insurance when we paid off our mortgage. House was purchased at $97,500 in 1985. Burned down in a wildland fire in 2006. Insurance company paid us over $550,000 for the house and another 70% for contents. Premiums before the fire were in the $2,000 range annual and after the fire in the $3,000 range annual.
Best roll of the dice I ever made. If I had rolled the other way and dropped coverage, I would have not been able to afford to stay in California.
Also, consider this: if you lose your home in a disaster, you can not just walk away from the mess. I spent over $100,000 in clean up and restoration of the land before I could pound one nail into one board. If you can afford to walk away from your home, just know there's more expense than just the market value, such as the clean-up, hazardous materials work. And the land still belongs to you. Including property taxes, electric, water, etc utilities that have a flat base cost. Try to sell a parcel that has the ruins of a burned house on it. Likely the cleanup could cost more than the land is worth.
Another consideration; if you lost your house, you'd likely also lose a lot of other stuff of value: RV, cars, boat, etc. Unless fully covered, you'll have those costs to restore those lost possessions.
Now that you've paid off the house, don't chinch out now. You'd be sorry if you had a catastrophic loss.