Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Because it excercises thinking about a pelican riding a bike (not common) and then describing that using SVG. It's quite nice imho and seems to scale with the power of the LLM model. Sure Simon has some actual reasons though.


> Because it excercises thinking about a pelican riding a bike (not common)

It is extremely common, since it's used on every single LLM to bench it.

And there is nothing logic, LLMs are never trained for graphics tasks, they dont see the output of a code.


I mean the real world examples of a pelican riding a bike is not common. It's common in benchmarking LLM's but that's not what I meant.


The only thing it exercises is the ability of the model to recall its pelican-on-bicycle and other SVG training data.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: