For centuries, the Israelites were guided by great and important leaders, yet throughout this entire period, God never requested a permanent structure for Himself. He points out that He never approached any of the leaders He appointed to shepherd and guide the nation [ביאור שטיינזלץ] to ask why a temple had not been constructed.
Furthermore, this lack of initiative was mutual. Not only did God refrain from demanding a permanent house, but the past leaders never even considered building one on their own. This highlights a unique quality in King David, who was the very first to conceive of this idea independently [רש״י].
When reflecting on these past figures, earlier historical records use a term that typically translates to the "tribes" of Israel. However, this word is actually a reference to the staff or scepter held by those in power. This clarifies that God is not referring to the general tribes themselves, but specifically to the judges and leaders who wielded authority over the nation [רד״ק, מלבי״ם].