The reason we don’t use “had” when asking a question that begins with “did” is because “had” is not an auxiliary verb that can be used to form questions in the simple past tense. The auxiliary verb “had” is used to form questions in the past perfect tense. For example, “Had you eaten breakfast before you went to work?” or "Had she gone to the store before she came home?"