Do you generally enjoy workdays more than you enjoy Saturdays?
If you are the type of person who frequently wakes up on a Saturday or Sunday morning, gleefully anticipating jumping in the car and going in to work to finish just a few more things that you are dying to get done, then I think you probably shouldn't retire just yet.
On the other hand, if you are the type of person who looks out the window from work on weekdays, and wishes you were out there doing something else instead of stuck inside, then I think you probably should retire.
If you are neither of these, then I don't know. When we are working, often all of our free time on the weekends is taken up by chores, home maintenance, and so on. Maybe you should spend your weekends and holidays exploring your interests and having fun, doing any chores after work on weekdays so that you can leave these weekends open for fun. Then you can contemplate how you feel each Sunday evening when you know that tomorrow it will be time to go back to work.