Correct me if I'm wrong, but satellites... orbit. They don't just fly in arbitrary directions following a target.
Even something like a rain storm can lose visual track of a carrier group, or even just night time, at which point you've now got an increasingly large area to search again to find the carrier which can be anywhere inside a several hundred mile circle.
