At the exact moment the nation fractures, the new political borders of the kingdom begin to take shape. The Israelites living within the cities of Judah, which include the tribes of Judah and Benjamin as well as individuals from other tribes who settled in the region, emerge as the sole group to immediately accept Rehoboam as their king [מלבי״ם, ביאור שטיינזלץ]. He officially establishes his reign over this specific population.
Meanwhile, the rest of the Israelite tribes depart in anger and return to their homes. However, at this early stage, their rebellion is not yet absolute. They have not yet chosen an alternative king to replace Rehoboam. This pause creates a brief window of hope. If Rehoboam had simply left them alone and refrained from taking any further action, the national rift might never have become permanent [מלבי״ם].