וַֽיִּגְּשׁוּ֙ אֶל־הָאִ֔ישׁ אֲשֶׁ֖ר עַל־בֵּ֣ית יוֹסֵ֑ף וַיְדַבְּר֥וּ אֵלָ֖יו פֶּ֥תַח הַבָּֽיִת׃
And they came near to the steward of Joseph’s house, and they spoke unto him at the door of the house,
Radak on Genesis
פתח הבית, in order that the people of Joseph’s household should not overhear them.
Rav Hirsch on Torah
Am Eingang des Hauses... Sie fürchteten sich, hineinzufolgen.