Following his sincere repentance, King Manasseh takes practical steps to purify Jerusalem and the Temple from idolatry [ביאור שטיינזלץ]. He actively removes the foreign gods and the carved idol from the House of God, along with all the altars he had previously built on the Temple Mount and throughout the city.
However, this process of purification is flawed. Rather than completely destroying the idols by shattering them or hiding them away permanently, Manasseh merely casts them outside the city limits. This incomplete eradication brings about severe consequences later on. Because the statues are left intact, his son Amon eventually finds them in the exact spot where his father had discarded them. Amon then takes these very same idols and resumes their worship, falling right back into the destructive practices his father had tried to leave behind [רש״י].