i think he knows venturing out to get walt from the others isn't gonna be a group thing, so he's being sneaky about it. as we see from the preview of the next ep. he runs off with some firepower to get his "boy" back, ALONE. that's when the "hunting party" goes after him.