> Where is there supposed to be info for the search engine to crawl?

You actually make me realize how rarely I end up on websites I haven't seen, and how different it is compared to two decades rego.