Jules,
I am a landlord myself. The answer to your question depends. If you are actively acquiring properties and your goal is to go from 4 to 12, then you should refi, pull out money, and buy more.
However, if you are planning to get these paid off as soon as possible and live on the rental...