Following the destruction of the Temple, the surviving population was broken and displaced. Yochanan ben Kareach and the military commanders took action by gathering the remaining people together.
This gathered remnant was specifically made up of Jews who had previously fled the disaster. During the crisis, they had scattered across various neighboring countries to find safety. Eventually, these refugees made the journey back home. Their clear purpose in returning was to resettle the land of Judah and build their lives there once again [מצודת דוד, ביאור שטיינזלץ].