וַיְהִ֧י אֱלֹהִ֛ים אֶת־הַנַּ֖עַר וַיִּגְדָּ֑ל וַיֵּ֙שֶׁב֙ בַּמִּדְבָּ֔ר וַיְהִ֖י רֹבֶ֥ה קַשָּֽׁת׃
And God was with the lad, and he grew; and he dwelt in the wilderness, and became an archer.
Zohar
"And Pharaoh commanded his men concerning him; and they sent him away..." (Gen. 21:20). Come and behold, The Holy One, blessed be He, is the protector of the righteous, who shields them from being ruled by other people. So the Holy One, blessed be He, protected Abraham, so no one could harm him or his wife.