Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Accountant, graded by human CPAs

keepertax.com

Post reply on HN
Print view View original

11–15 of 15 posts

Re: AI Accountant, graded by human CPAs

#11

Post by boringuser2 »

pkoullick92 wrote: post #9
boringuser2 wrote: post #8

What'a the average grade of a single human CPA?

Yes - that is the right question :) We'll do a followup where we figure this out because I agree that it's relevant. I would guess 95% at most.

This seems very complex given that I know little about accounting. Obviously, you'd need to invent some kind of standardized test for real data.

For example, if you administered a leetcode style examination to me, even at the easy level, I'd probably fail miserably compared to an AI.

However, I am a far more competent professional programmer than an AI.

Is accounting all just rote knowledge? Is there some degree of correctness that can be measured?

Will be interested to see what you come up with if you plan to put data behind your business model.

Re: AI Accountant, graded by human CPAs

#12

Post by bshipp »

boringuser2 wrote: post #11
pkoullick92 wrote: post #9

Earlier quoted context omitted.

Yes - that is the right question :) We'll do a followup where we figure this out because I agree that it's relevant. I would guess 95% at most.

This seems very complex given that I know little about accounting. Obviously, you'd need to invent some kind of standardized test for real data. For example, if you administered a leetcode style examination to me, even at the easy level, I'd probably fail miserably compared to an AI. However, I am a far more competent professional programmer than an AI. Is accounting all just rote knowledge? Is there some degree of c…

My wife is a CPA accountant and I'll go out on a limb and say that 80% of her time is spent doing the equivalent of data cleaning and validation. The balance of her time is making judgement calls so she can appropriately reconcile notional rules against the messiness of real world business transactions.

Re: AI Accountant, graded by human CPAs

#13

Post by boringuser2 »

bshipp wrote: post #12
boringuser2 wrote: post #11

Earlier quoted context omitted.

This seems very complex given that I know little about accounting. Obviously, you'd need to invent some kind of standardized test for real data. For example, if you administered a leetcode style examination to me, even at the easy level, I'd probably fail miserably compared to an AI. However, I am a far more competent professional programmer than an AI. Is accounting all just rote knowledge? Is there some degree of c…

My wife is a CPA accountant and I'll go out on a limb and say that 80% of her time is spent doing the equivalent of data cleaning and validation. The balance of her time is making judgement calls so she can appropriately reconcile notional rules against the messiness of real world business transactions.

This seems similar to basically all knowledge-work.

99% hampered with low-cognitive throughput tasks, where most of your business value is generated in the 1% of what you do.

It's possible that AI isn't close to replacing human efforts.

Re: AI Accountant, graded by human CPAs

#15

Post by ChatGTP »

pkoullick92 wrote: post #10
AH4oFVbPT4f8 wrote: post #7

I asked it “What is the journey entry if you use cash to pay off a liability?” And it correctly answered.

Yeah, it's weirdly good at things that are "hard" and then bad at things that are "easy"

This sums up most intellectuals quite well.
Post reply on HN