"Is there any reason to believe that private prisons are significantly worse than publicly run prisons?"

They have a profit motive to lobby for harsher penalties, and to do the absolute bare minimum for prisoner housing and health.

"but is there any reason to believe that society is better off with exclusively publicly run prisons?"

Yes. I, for one, do no buy the bullshit that says that private entities are always better than public ones.