Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
OpenAI o1-preview is SOTA on the aider leaderboard (aider.chat)
5 points by anotherpaulg on Sept 13, 2024 | hide | past | favorite | 1 comment


OpenAI o1-preview is SOTA at 79.7% on the aider code editing leaderboard, with "whole" edit format. With the practical "diff" format, it ranks between GPT-4o & Sonnet.

  80% o1-preview whole
  77% Sonnet diff
  75% o1-preview diff
  75% Sonnet whole
  71% GPT-4o diff




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: