61–70 of 118 posts
I’ve gotten away with Plotly. Easy enough and looks great.
If you and I sit in a room and race to analyze a few CSVs of data, I bet I can find compelling trends faster using a BI tool.
Earlier quoted context omitted.
Interesting. To me, you seem to be conflating some pieces of data infra plumbing with very sensible and concrete goals (Kafka, Hadoop) with others that are adjacent tools which may or may not make sense. Regardless of any tech details, the idea behind Kafka makes a lot of sense: https://engineering.linkedin.com/distributed-systems/log-wha... Or did you mean, "I have no idea what business needs all this data for", a m…
Well ideas behind all the other stuff will also make lot of sense if one align with perspective of snake oil salesman. And I do think Kafka/hadoop etc fit in snake oil category. Linkedin saying Kafka is good for them is not saying much.
Must be solving some problem for them, eh?
As someone who runs teams deploying BI to internal stakeholders (product, sales) I am pretty fed up with them. Firstly Tableau, QlikView or PowerBI are all pretty much doing the same thing whatever flavour you prefer. We find that maybe 10% of users will actually use them to garner new actionable insights and 90% will moan there's too much data for them to process and no one appreciates the immense amount of data mun…
So then we have to get our db people in to rewrite all of their reports so they don't do this which eliminated the benefit of having the customers do it.
In the end there is just no avoiding having experts build the dashboards.
As someone who runs teams deploying BI to internal stakeholders (product, sales) I am pretty fed up with them. Firstly Tableau, QlikView or PowerBI are all pretty much doing the same thing whatever flavour you prefer. We find that maybe 10% of users will actually use them to garner new actionable insights and 90% will moan there's too much data for them to process and no one appreciates the immense amount of data mun…
We provide power bi access to the data our app runs on and it has been a mixed bag. The customers absolutely love it. But they build dashboards where hitting the refresh button can bring a super expensive db to its knees for half an hour. So then we have to get our db people in to rewrite all of their reports so they don't do this which eliminated the benefit of having the customers do it. In the end there is just no…
Earlier quoted context omitted.
We provide power bi access to the data our app runs on and it has been a mixed bag. The customers absolutely love it. But they build dashboards where hitting the refresh button can bring a super expensive db to its knees for half an hour. So then we have to get our db people in to rewrite all of their reports so they don't do this which eliminated the benefit of having the customers do it. In the end there is just no…
Are you running analytics on an transactional database?
And companies are trying. Ex:https://www.bobsguide.com/articles/barclays-gordon-risk-mana...
But I also see spending more on these tools, in the name of innovation, because some bigshot likes tool X and that's what he wants to use. And guess what, now you also need it to be made available in the cloud.
As someone who runs teams deploying BI to internal stakeholders (product, sales) I am pretty fed up with them. Firstly Tableau, QlikView or PowerBI are all pretty much doing the same thing whatever flavour you prefer. We find that maybe 10% of users will actually use them to garner new actionable insights and 90% will moan there's too much data for them to process and no one appreciates the immense amount of data mun…
When it comes to business stakeholders, the biggest obstacle is trust. If you're not a data person, or a developer, decision logic being gated behind code is a scary black box. "If I can't control it, I can't trust it". That feeling gets even worse when we build systems that are controlled by AI or ML.
I think we need more solutions for data teams that allow business stakeholders to take part in the automated workflow deployment. Let them see how things are connected together. Let them verify that the decisions are being made correctly every day. Let them tweak levers so they have a say in how things are working. That's the only way to move beyond the current environment where everyone wants a dashboard, but no one looks at it.
That's a big problem I'm aiming to solve right now.
Sure, each of these tools are better suited to accomplishing a very specific task with your data. But the problem is that now these tools aren't talking to each other. No one has a single place to view their data end-to-end. No one can show me every automated process in their organization that relies on a specific table. Everything is tied together with trust. Trust that the Data Engineering team won't deploy bad code. Trust that the API won't change how it returns data. Trust that the data actually loaded completely.
This trust-based system means that one problem during ingestion/cleaning ends up spelling disaster for all of the downstream ML models, reports, data extracts, etc. and causes a day worth of headaches to resolve.
If BI used to hold everything together under one roof, we need something to make these tools talk to each other. The only solution, as I see it, is to build out better data orchestration that effectively glues these tools together and lets you see the "big picture" with your data.
Earlier quoted context omitted.
its the ERP software that we use. people needs to do report with data from NetSuite.
Why not create a "copy" of NetSuite data to a more friendly format? I mean to sync NetSuite data to another database.