LLMs are very sensitive to leading questions. A small hint of that the expected ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		felipeerias 4 months ago \| parent \| context \| favorite \| on: An LLM is a lossy encyclopedia LLMs are very sensitive to leading questions. A small hint of that the expected answer looks like will tend to produce exactly that answer.

giantrobot 4 months ago | [–]

You don't even need a leading direct question. You can easily lead an LLM just by having some statements (even at times single words) in the context window.

SAI_Peregrinus 4 months ago | [–]

As a consequence LLMs are extremely unlikely to recognize an X-Y problem.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact