Yes, you'd do better, but you'd still have a LLM that is designed to predict the most likely next words. It would still hallucinate and invent case law, it would just be even harder for a non-lawyer to recognize the hallucination.