Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hacker News Activity Analysis with GPT-4 Agent

eu.getdot.ai

Post reply on HN
Print view View original

11–20 of 54 posts

Re: Hacker News Activity Analysis with GPT-4 Agent

#11

Post by zurfer »

andreshb wrote: post #6

Do you have samples of time-based cohort analysis? Most other solutions out there struggle to do the steps to generate time-based heatmaps and line graphs of cohort analysis. Averages, medians, and anything that can be done on a spreadsheet by a high schooler, GPT does well with.

In our experience Dot can come up on the fly with cohort analysis charts if the underlying data is well structured. In most cases however, some level of explanation, example or data preparation is needed for robust and repeated cohort analysis. Also for good query performance it's usually best to precalculate some things.

https://eu.getdot.ai/share/135b4e3f-2526-4d1c-ac69-d1716133f...

Re: Hacker News Activity Analysis with GPT-4 Agent

#12

Post by posting_mess »

Love how the demo falls pray to what I dont have a term for, "the SQLers assumption"?

It asks ChatGPT to write SQL to get sales data, ChatGPT (or most SQLers) trust that every year-month combo has atleast one entry - which means the graphs its presenting could be wrong. Because if there was no entries for a year-month it it will skip that year-month and make it look like you never had a 0 month.

I've made this mistake before in prod, and without some janky lookup table of every date in existence... you need more code :( Fairly few people actually notice the potentially missing month, but still its a bug n a bad one.

Looks cool regardless though, good luck!

Re: Hacker News Activity Analysis with GPT-4 Agent

#13

Post by vincnetas »

throwitaway222 wrote: post #10
__loam wrote: post #8

The fact that we're mostly posting during work hours is hilarious.

If hackernews, youtube and reddit all went down for a month, our GDP would go up 2x.

Some people are paid to be available on demand, not to continually produce output. Somtimes we pretend that its not and come up with some busy work, but most of the time you are cheper to have on a payroll than to hire consultant on demand. So tou spend some of the time idling in HN.

Re: Hacker News Activity Analysis with GPT-4 Agent

#14

Post by BudaDude »

throwitaway222 wrote: post #10
__loam wrote: post #8

The fact that we're mostly posting during work hours is hilarious.

If hackernews, youtube and reddit all went down for a month, our GDP would go up 2x.

If that happened, we would all go back to blogging and web rings. Don't doubt the laziness of office workers.

Re: Hacker News Activity Analysis with GPT-4 Agent

#15

Post by zurfer »

posting_mess wrote: post #12

Love how the demo falls pray to what I dont have a term for, "the SQLers assumption"? It asks ChatGPT to write SQL to get sales data, ChatGPT (or most SQLers) trust that every year-month combo has atleast one entry - which means the graphs its presenting could be wrong. Because if there was no entries for a year-month it it will skip that year-month and make it look like you never had a 0 month. I've made this mistak…

Thanks!

You probably refer to one of the demos on our landing page?

I like how you describe the problem. You're absolutely right that SQL seems easy but it's these edge cases that make it hard to get right. Joining metrics with a date spine is definitely a good practice to avoid missing date periods.

I think we could/should teach Dot to do that in the future. It should at least be a feature you can turn on as the data team.

Re: Hacker News Activity Analysis with GPT-4 Agent

#16

Post by greenie_beans »

this is real neat! can't wait to see where this goes.

after seeing the demo, i immediately wanted to sign up and input a google sheet where i'm tracking my health stats from a current case of covid. but yall don't have that connection. a google sheets connection would be handy. so many orgs i work with use that. it's not the best way for people to maintain data, but a lot of people still use it.

also, the sign up with elon musk placeholder text was a turn off. regardless of how one personally feels about him, you could put any person there and somebody wouldn't like it. it's too risky and imo nobody needs placeholder text for a personal info form. i imagine this is early startup branding experiments which i respect, but thought i'd offer my unsolicited feedback.

Re: Hacker News Activity Analysis with GPT-4 Agent

#17

Post by supportengineer »

posting_mess wrote: post #12

Love how the demo falls pray to what I dont have a term for, "the SQLers assumption"? It asks ChatGPT to write SQL to get sales data, ChatGPT (or most SQLers) trust that every year-month combo has atleast one entry - which means the graphs its presenting could be wrong. Because if there was no entries for a year-month it it will skip that year-month and make it look like you never had a 0 month. I've made this mistak…

>> janky lookup table of every date in existence

Having a date dimension provides an elegant solution in many cases.

Re: Hacker News Activity Analysis with GPT-4 Agent

#18

Post by tomrod »

posting_mess wrote: post #12

Love how the demo falls pray to what I dont have a term for, "the SQLers assumption"? It asks ChatGPT to write SQL to get sales data, ChatGPT (or most SQLers) trust that every year-month combo has atleast one entry - which means the graphs its presenting could be wrong. Because if there was no entries for a year-month it it will skip that year-month and make it look like you never had a 0 month. I've made this mistak…

I call this "spineless" because you're missing the "vertebrae" of a year-month count.

I find that many places need a spine.

Re: Hacker News Activity Analysis with GPT-4 Agent

#19

Post by tomrod »

supportengineer wrote: post #17
posting_mess wrote: post #12

Love how the demo falls pray to what I dont have a term for, "the SQLers assumption"? It asks ChatGPT to write SQL to get sales data, ChatGPT (or most SQLers) trust that every year-month combo has atleast one entry - which means the graphs its presenting could be wrong. Because if there was no entries for a year-month it it will skip that year-month and make it look like you never had a 0 month. I've made this mistak…

>> janky lookup table of every date in existence Having a date dimension provides an elegant solution in many cases.

It can. A function that generates date objects between two date objects is also pretty performant for specific uses.

Re: Hacker News Activity Analysis with GPT-4 Agent

#20

Post by posting_mess »

zurfer wrote: post #15
posting_mess wrote: post #12

Love how the demo falls pray to what I dont have a term for, "the SQLers assumption"? It asks ChatGPT to write SQL to get sales data, ChatGPT (or most SQLers) trust that every year-month combo has atleast one entry - which means the graphs its presenting could be wrong. Because if there was no entries for a year-month it it will skip that year-month and make it look like you never had a 0 month. I've made this mistak…

Thanks! You probably refer to one of the demos on our landing page? I like how you describe the problem. You're absolutely right that SQL seems easy but it's these edge cases that make it hard to get right. Joining metrics with a date spine is definitely a good practice to avoid missing date periods. I think we could/should teach Dot to do that in the future. It should at least be a feature you can turn on as the dat…

> You probably refer to one of the demos on our landing page?

Indeed, not sure how I ended up there but did on mobile, commented here.

> You're absolutely right that SQL seems easy but it's these edge cases that make it hard to get right

SQL/data analysis is endlessly pesky! I assume it would be easier to spot on tighter increments like "minutely" or "hourly"

> It should at least be a feature you can turn on as the data team.

Some might want the missing points, others wont - sounds like a good option (but id default to "enabled", each to their own though)

Post reply on HN