How can it be well established when the LLMs are still actively changing and improving.

Don't think we can say, statistical systems can have incorrect results, hence we no longer need to study how statistical system produce incorrect results, because we already know they can have incorrect results.