I have owned a 2nd home, a log cabin with 3 acres up in the mountain, for several years. DW and I all got tired of the maintenance. Staining, caulking, mowing, planting, fixing things, etc. Every time we go there, we had to work on something.
We sold our 2nd home, and now we rent - we enjoy renting way much more, as we really enjoy our vacation and forget the maintenance part. We also have a timeshare and we stay in 2 - 3 bedroom penthouse-like suites. It's just more enjoyable without the maintenance.
If you enjoy your second home now and have not gotten tired of it, that's good. But it is not theory - I have owned a second home .. been there done that, and we have grown to hate the maintenance. This is first hand experience.