https://platform.openai.com/docs/guides/prompt-caching#requirements > Caching is... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		moebrowne 10 days ago \| parent \| context \| favorite \| on: Prompt caching for cheaper LLM tokens https://platform.openai.com/docs/guides/prompt-caching#requi... > Caching is available for prompts containing 1024 tokens or more. No mention of caching being in blocks of 1024 tokens thereafter.

IanCal 10 days ago [–]

At launch it was described as being in blocks of 128

https://openai.com/index/api-prompt-caching/

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact