Midrash for Genesis 5:23

R. Joshua the son of Levi declared: If the nations had known how important the Tabernacle and the Sanctuary were to them, they would have encircled them with tents and forts to protect them. Even before the Tabernacle was erected, the word of God had gone forth into the homes of the idolatrous people and caused them to become panic-stricken. Whence do we know this? It is written: For who is there of all flesh, that hath heard the voice of the living God speaking out of the midst of fire, as we have, and lived? (Deut. 5:23). You hearkened to His voice and have survived, but the idolatrous people, on hearing (His voice), became panic-stricken within their tents and perished.