Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They get paid for inference, those tokens might as well be monetary tokens.




This is exactly the problem.

Companies currently are being sold that they can replace employees with little agents that cost $20 to $200 a month.

But then they realize that the $200 last for about 3.5 hours on day 1 of the month and the rest will be charged by the token. Which will then cost as much or more than the employee did, but with a nice guaranteed quota of non determinism and failure rate included.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: