After their offer to participate in the construction of the Temple was firmly rejected, the local residents began a campaign of harassment. Because the Persian Empire was highly organized and Zerubbabel held an official royal appointment, these locals could not launch an open war against the returning exiles. Instead, they resorted to indirect tactics aimed at intimidation and breaking the people's morale [רס״ג, ביאור שטיינזלץ]. These local inhabitants are identified as the historic enemies of Judah and Benjamin [רש״י], with some identifying them specifically as the Cutheans [רלב״ג, מלבי״ם].
Their initial strategy was to weaken the resolve of the builders. They sought to instill fear and dread into the hearts of the workers [מצודת דוד], creating a sense of physical weakness [מצודת ציון] and inducing a heavy laziness. Their goal was to make the people so sluggish and unmotivated that they would abandon their construction efforts entirely [רש״י, מלבי״ם].
The primary approach among commentators is that this harassment soon escalated into a campaign of severe panic and terror [אבן עזרא]. After their attempts to make the workers lazy, the enemies intensified their tactics, actively terrorizing the people to physically stop them from building [רש״י, מצודת דוד, רלב״ג, מלבי״ם]. However, a unique perspective suggests a different dynamic on the construction site. While the enemies were busy weakening the morale of the people, the resulting sense of panic and urgency actually came from the Jewish leadership. According to this view, the heads of the families reacted to the enemy disruptions by rushing and pressuring the workers to continue building, even against their own will [רס״ג].