What does Numbers 33:55 mean?

But if you don't drive out the people living there, they'll become like thorns in your sides and trouble you in the land you settle. Numbers 33:55 - Modern Text Bible

(God warns that if they let the locals stay, those people will cause constant problems and pain.)