It's quite a lot less space than you think. There's a giant dump outside Denver international airport that is orders of magnitude larger than we'd need. There are of course other factors, but space is not one of them.
One of the great parts of using a breeder reactor is it burns up all the harmful fuel. What's left decays very quickly, so there just isn't much to store.