Because the VLM doesn't know it hallucinated. When you get a Tesseract error you can flag the OCR job for manual review.

Hallucinations are hard to detect unless you are a subject-matter expert. I don't have direct experience with Tesseract error detection.

Latter is more likely to get debugged.

It could hallucinate obscene language, something which is less likely with classic OCR.