נחמיה ד:ט פירוש: רש״י

that it had become known to us that they were coming to fight against us.

and we all returned We all returned from the place where we had gathered to meet the enemies, each one to his work in the building of the wall.