I think it's possible but highly unlikely, given all the previous iterations of technology we've seen people come to trust despite its limitations.

Like what? Every new form of media has a wild-west phase where people are credulous; eventually people end up jaded.

It won't happen due to Gell-Mann amnesia. It "helps" that LLMs never admit to not knowing something. So from average user point of view it looks like the agents know everything and are only under-educated in the one domain the user is actually the specialist.