At a first Glance, SuperSet seems a bit limited compared to Grafana.
I could try playing around with Grafana as well, thanks for the tip!
Show HN: Database for analyzing US companies, visualize using Apache SuperSet
31–40 of 45 posts
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#32Earlier quoted context omitted.
The data is refreshed nightly for stocks. And monthly from SEC once it is available to download. There is no guaranteed data delivery SLA that I know about from SEC, so I get it monthly once it arrives. I talk more about this in detail on the website, I will also update the data documentation tab, and in tutorials. https://tesseractanalytics.ai/finance-data-quarterly-data-do...
data in edgar is usually available next business day after company filed documents.
Yes, but they do not necessarily offer it as a dump right away. So I am still relying on monthly dumps.
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#33Earlier quoted context omitted.
data in edgar is usually available next business day after company filed documents.
Yes, but they do not necessarily offer it as a dump right away. So I am still relying on monthly dumps.
they do, here are daily files with references on filing for Apr: https://www.sec.gov/Archives/edgar/daily-index/2023/QTR2/
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#34nice work, how big is the dataset? @tessbi
Well the quarterly one is much smaller then say, the daily one.
Select count(*) from superset.company_financials_quarterly; = 458,573.
I have >6000 companies, with over 80 features/columns.
I cannot post daily data through SuperSet, because people will query the whole dataset without filters, and it will be too slow.
But I have it just in case people want the daily stock charts in the future.
Cheers.
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#35Earlier quoted context omitted.
Yes, but they do not necessarily offer it as a dump right away. So I am still relying on monthly dumps.
they do, here are daily files with references on filing for Apr: https://www.sec.gov/Archives/edgar/daily-index/2023/QTR2/
Thank you! Yes, but I am using their monthly dumps for now, because it was easier for data warehousing.
I will put it in my plans to pull data daily incrementally in the future as a next phase.
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#36Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#37This is very cool! Would be amazing if you could pass in data in a certain format (like the SEC data) from non-US companies as well and view/compare data in the same way.
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#38This is very cool! Would be amazing if you could pass in data in a certain format (like the SEC data) from non-US companies as well and view/compare data in the same way.
That would be in the future for sure, US data is just much easier to work with right now.
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#39This seems like your going down the rabbit hole into an area where only the bigs can compete, its also a fools errand in my opinion.
There's a growing sentiment that the stock market is rigged, and I've seen several instances where that almost certainly seems to be the case and no action has been taken. It started with the COMEX eligible silver and gold holdings which have never been independently audited.
Then GME and FRC more recently.
Once you realize the mechanisms that allowed those to be successful, you realize they can do it with any publicly traded company, and its no longer an investment because the fundamentals have nothing to do with it. You can cause companies to fail simply by causing aggregated indebtness violations. Synthetic shares can be created indirectly which let you create more selling or buying than exist in the float. There's only one way the the basic mechanics say happens when that exists.
Its a casino, no longer a real investment and any company with better funding alternatives won't go public if they intend to stay in the business for longer than a few years. Most of the companies are zombie companies which are overvalued. Some are undervalued. Its not a good business to be in, there's some real evil schmucks playing games with information that isn't public.
Re: Show HN: Database for analyzing US companies, visualize using Apache SuperSet
#40Earlier quoted context omitted.
Is there a way to register without it also creating a WordPress account?
Yeah, I suppose I can remove that feature, I just thought if people wanted to add comments or blog on my tutorials. Just message me in Contact Us, I will remove you from WordPress.
That sounds like a good use case. How making it optional?