מדרש על בראשית 42:6

Another interpretation (of Prov. 14:23): IN ALL TOIL THERE IS PROFIT. This was Joseph, who suffered in prison and had gain.⁶Gen. R. 89:2; Exod. R. 7:1. NOW (according to Gen. 42:6) JOSEPH WAS THE GOVERNOR. (Prov. 14:23:) BUT TALK FROM THE LIPS < LEADS > ONLY TO A LOSS. Because he had spoken < merely > with his lips and said < to a cupbearer rather than to God > (in Gen. 40:14): BUT KEEP ME IN YOUR REMEMBRANCE, the Holy One said to him: By your life, inasmuch as you spoke improper words with your lips; by your life, you are doing two years more in the prison. Thus it is stated (in Genesis 41:1): NOW IT CAME TO PASS AT THE END OF TWO FULL YEARS.

Alternatively, "when [the Lord] enlarges [your territory]" (Deuteronomy 20:12). "Let me exult and rejoice in Your loving-kindness when You notice my affliction, are mindful of my deep distress, and do not hand me over to my enemy, but grant me relief" (Psalms 31:8-9). The Rabbis say, this verse refers to Joseph. Joseph said, "Master of the universe, let me exult and rejoice in your loving-kindness that you have done for me. Had you [only] called Potiphar's wife to account for me, but not given me the powers of a sovereign, I would have been joyful and happy, now that you've also given me the powers of a sovereign, I will exult and rejoice in your loving-kindness." "When you notice my affliction", this [too] refers to Joseph, about whom it is written, "His feet were afflicted in fetters; an iron collar was put on his neck" (psalms 105:18). "and did not hand me over to my enemy" - this is Potiphar [who sought to imprison Joseph for life]. "but grant me relief", since he caused me to rule over the entire land of Egypt. From where is this derived? From the verse: "Now Joseph was the vizier of the land; it was he who dispensed rations to all the people of the land..." (Genesis 42:6). Alternatively "Let me exult and rejoice" is speaking about [the Children of] Israel. The Children of Israel said, "Master of the universe, let me exult and rejoice in your loving-kindness that you have done unto us, for had you [only] freed us from the Egyptians and not given us their money, we would have be gladdened, [but] what joy and happiness we have [now] that you have given us [also] their wealth. "when you notice my affliction" this refers to the Israelites about him it was written: "The Egyptians dealt harshly with us and oppressed us; they imposed heavy labor upon us. We cried to the LORD, the God of our fathers, and the LORD heard our plea and saw our affliction, our misery, and our oppression" (Deuteronomy 26:6-7). "are mindful of my deep distress" this refers to the Israelites, about whom it is written "they made life bitter for them" (Exodus 1:14). "and do not hand me over to my enemy" - this refers to the evil Pharaoh, as it is written "The foe said, “I will pursue"" (Exodus 15:9). "But grant me relief", that you widened our borders, as it says, "when [the Lord] enlarges [your territory]" (Deuteronomy 20:12).