If you can pay the conversion tax without incurring any extra tax to withdraw from your taxable accounts, that is preferable because you get the full amount of the conversion into the Roth account.
If it is going to cost extra tax to withdraw from your taxable account, then it depends on "how much extra?" The general issue is described in the
"Traditional plus taxable" vs. Roth section of that wiki article, and the "toolbox" spreadsheet linked there will do the math given your situation.