In a tense interrogation, an alibi meant to prove innocence can sometimes become the very evidence that seals a conviction. When the accused offer deeply personal details to clear their names, the interrogator can seize upon those very words to solidify the case against them.
The primary approach among commentators is that Joseph firmly stands by his initial accusation. Far from agreeing with the brothers' defense, he declares that his original charge of espionage remains the absolute truth [רש״י, מזרחי, גור אריה, שפתי חכמים, הכתב והקבלה, דברי דוד]. He does not retract his statement, emphasizing instead his unwavering commitment to the claim that they are spies [אור החיים, ברכת אשר].
The commentators explain several ways the brothers' volunteered information actually incriminated them. First, their claim of being sons of a single man works against them. If they truly belong to one family, it makes little sense to send ten men merely to purchase grain, a task easily handled by one or two individuals. Leaving their elderly father behind while the household is left to a young child suggests their story is fabricated. Instead, it appears far more likely that they are representatives of ten different factions who have banded together for the purpose of espionage [רד״ק, מלבי״ם, ביאור יש״ר, יריעות שלמה].
Furthermore, revealing the existence of a youngest brother at home and another who is no longer with them raises deep suspicion. Joseph implies that the missing brother is actually an accomplice who went ahead to report their findings [ספורנו, הכתב והקבלה], or perhaps was caught and killed during his own spying mission [העמק דבר]. The fact that they did not bring the youngest brother suggests they were afraid he might testify and expose their fabricated story, or simply that he was too young to engage in the cunning work of espionage [כלי יקר, בכור שור, קונטרס חיבה יתירה, רש״ר הירש]. Beyond the specific details, the sheer volume of information they provide casts doubt on their innocence. Instead of giving a brief answer, they offer excessive, unsolicited details. This oversharing creates the impression of practiced liars who prepared a complex cover story in advance to deceive the local authorities [שד״ל, ביאור שטיינזלץ].
An additional layer of interpretation reveals a hidden interrogation that explains the severe accusation. According to this tradition, Joseph tested the brothers by asking what they would do if they found their lost brother and were asked to pay an enormous ransom. When they insisted they would pay any price, he pressed further, asking how they would react if the captors refused to release him. The brothers declared that they had come prepared to kill or be killed. This aggressive response allowed Joseph to confirm his accusation, claiming their true intention was to destroy the city, just as they had previously done in Shechem [רש״י, ברטנורא, צאינה וראינה]. This exchange highlights a glaring inconsistency. It is highly improbable that men who made no effort to search for their missing brother for years would suddenly be willing to sacrifice their lives for him. This utter lack of plausibility only strengthens Joseph's argument that their story is a complete lie, designed to mask a violent plot against the city's inhabitants, an act that falls squarely under the definition of espionage [ברכת אשר, אור החיים].