I did have a somewhat largish Lionel set that my Dad took instead of money for a wiring job. (He was an electrician, worked for the electrical utility, and did small household-type wiring jobs on the side.)
But it was just the train set and a few accessories and we never really had the space or money to do a proper layout with it. It was fun nonetheless. Animal lovers may cringe at this, but I and a couple of neighborhood guys would sometimes capture a large ant, tie it to the tracks with thread, and then run over it with the train. Poor Pauline.
When preparing to move I sold it to a local shop that dealt in them since I hadn't touched it for 20+ years, figuring it would end up in the hands of someone who would actually use it.