Just asked it about Washington State's new 7% capital gains tax and it got the question right. Looks like it's trained on state stuff too.

Yep, no plugins just yet - we just passed in tax law changes since 2021

I posted questions related to recent tax changes to real estates, capital gains, and retirements. All were answered accurately. Great job!

Nice

I asked it “What is the journey entry if you use cash to pay off a liability?” And it correctly answered.

Yeah, it's weirdly good at things that are "hard" and then bad at things that are "easy"

This sums up most intellectuals quite well.

What'a the average grade of a single human CPA?

Yes - that is the right question :) We'll do a followup where we figure this out because I agree that it's relevant. I would guess 95% at most.

This seems very complex given that I know little about accounting. Obviously, you'd need to invent some kind of standardized test for real data.

For example, if you administered a leetcode style examination to me, even at the easy level, I'd probably fail miserably compared to an AI.

However, I am a far more competent professional programmer than an AI.

Is accounting all just rote knowledge? Is there some degree of correctness that can be measured?

Will be interested to see what you come up with if you plan to put data behind your business model.

My wife is a CPA accountant and I'll go out on a limb and say that 80% of her time is spent doing the equivalent of data cleaning and validation. The balance of her time is making judgement calls so she can appropriately reconcile notional rules against the messiness of real world business transactions.

This seems similar to basically all knowledge-work.

99% hampered with low-cognitive throughput tasks, where most of your business value is generated in the 1% of what you do.

It's possible that AI isn't close to replacing human efforts.