Yes, that pesky speed limit (the speed of light) does get in the way of interstellar travel. 😏
Colonization might still be possible with known or reasonably hypothesized future technology, though. Imagine frozen human embryos sent on spacecraft equipped with artificial wombs and A.I. spacecraft...