There is no advantage of prefetching images from familiar senders. It's not about faster image loading.
The ideal thing would be to just prefetch all the images sent to existing and non existing accounts. This way there is absolutely no way for a spammer to tell whether an email is existing or not.
Sorry, I wasn't precise. I was responding to the suggestion to only proxy for familiar senders. But, assuming that you can correctly identify who is familiar and who's not (there is scam detection as well), the benefit is minimal.
There is bigger benefit of doing this proxy for non-familiar emails.
Google could prevent leaking if email address is valid by simply prefetching images even when email is sent on non existent accounts.