Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> We were cautious to only run after each model’s training cutoff dates for the LLM models

Grok is constantly training and/or it has access to websearch internally.

You cannot backtest LLMs. You can only "live" test them going forward.



Via api you can turn off websearch internally. We provided all the models with their own custom tools that only provided data up to the date of the backtest.


But Grok is internally training on Tweets etc. continuously.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: