What does Genesis 21:11 mean?

This really bothered Abraham because Ishmael was his son too. Genesis 21:11 - Modern Text Bible

(Abraham is deeply troubled by Sarah's demand, feeling torn because of his love for Ishmael.)