Yes, you need a digital dimmer, which goes for $30 and up.
They're electronic and will work with CFL as well.
If you go to lamprecycle.org, they'll tell you where they take old CFL bulbs.
$1.99 would have been a stupendous price for LED bulbs.
As noted earlier in the thread, CFL have warm up periods, especially in colder temperatures, before they hit their rated brightness levels. It's a coupe of minutes.