The indirect speech of he said to me, "Were did you go yesterday?"
He told me that where did I go yesterday.
He told me that where had you gone the previous day?
He asked me where I had gone the previous day.
He asked me if I had gone the previous day.