Ads are not the only challenge. Cost-per-query is also a challenge, as an LLM qu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		breadwinner 10 months ago \| parent \| context \| favorite \| on: I've largely replaced Google with ChatGPT for look... Ads are not the only challenge. Cost-per-query is also a challenge, as an LLM query is 10x more expensive than a search-index query.

IggleSniggle 10 months ago | [–]

Is that all? I hadn't thought about that aspect, but I find it a little surprising that, even just considering post-training, it isn't more expensive than that.

croon 10 months ago | [–]

I would assume (at minimum) 100x, but have not done any napkin math.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact