Live data from Hacker News

Show HN: Glue – Pandas as a DAG (Now a web app)

gluedata.io

21–30 of 30 posts

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#22
post #21

Did you use a particular library for the drag and drop graph building UI? Woukd like to know as I could use something like that for different project

Hey! Yeh I did https://g6.antv.vision/en although I think I might try using this https://x6.antv.vision/en if I could start again. X6 wasn't as well built out when I started though but its probably more suited to my use case with its interaction support. If you have other libraries that serve this purpose let me know because I did a lot of searching and thats the best I found at the time.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#24

Hey guys, I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way. Since doing that I took a job and am pretty burned out on the project. I was…

Just a note: the first thing I did was check to see if the project was open-source, and that was before reading your comment indicating you were considering publishing the source. I did that because I'm not willing to get locked in to another walled garden.

That does not, of course, imply that publishing it with a FOSS license is the right move for you! I just thought it might be helpful to report my behavior.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#25

Hey guys, I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way. Since doing that I took a job and am pretty burned out on the project. I was…

Just wanted to say: nice job! :) I can fully understand you burning out on something like this. How about declaring a time-out period where development is paused while you take a break? Maybe triage bug reports and feature requests in the meantime, but take some time to yourself to recover and reset your perspectives. Just a thought.

Thanks! Thats kinds of you to say. Appreciate that.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#26

Hey guys, I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way. Since doing that I took a job and am pretty burned out on the project. I was…

Just a note: the first thing I did was check to see if the project was open-source, and that was before reading your comment indicating you were considering publishing the source. I did that because I'm not willing to get locked in to another walled garden. That does not, of course, imply that publishing it with a FOSS license is the right move for you ! I just thought it might be helpful to report my behavior.

Yeh I get it. I appreciate the comment. Part of the reason I am considering open sourcing it would be to give the project more life than I can currently give it myself.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#27

Hey guys, I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way. Since doing that I took a job and am pretty burned out on the project. I was…

Very cool. A GUI pandas. As a seasoned user of pandas, the way it works seems clear. I get the potential appeal of a no-code solution like this: "Glue is to pandas as Airtable is to relational databases." The question in my mind: how many users are there that want to build these kinds of data transformation pipelines that are also unwilling to learn Python/pandas (or R, or some other equivalent)? Because once you need to build a custom lambda, or do something downstream of the transformation, like a custom data visualization, you need to know how to write code. Which I think gets to the heart of the matter: this replaces the easy part of data science. The hard parts are things like understanding what the columns really are, cleaning up messy data, and doing statistical modeling that yields valid insights. I think open-sourcing it is a good idea. I can see how this could be added to a more complete software ecosystem that is designed to be used by non-coders, like an in-house ELN for a biotech. But as a paid project, I'm almost surely not going to ever give it a try.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#28

Earlier quoted context omitted.

Would you be able to leverage singer taps / targets? https://www.singer.io

Oh this is very interesting, I had never heard of this. Yeh I could potentially use this. I do think using a third party library or provider makes sense to massively expand the input / output options. Seems like there is a standard schema for the different tap configs that I could pull and wrap in UI forms in a generalized fashion. I don't know if you think these are fair comment about the state of the project? - htt…

I actually use Stitch so I don’t have to host orchestration, which is how I came to know about Singer in the first place.

It’s true that Stitch got acquired by Talend, but Singer seems independent enough. I don’t understand why Stitch would “abandon” Singer. They’re a sponsor, and seems like they have an incentive to keep that ball rolling. Their bread and butter seems to be hosting orchestration, so more taps means more customers for them. There’s other stakeholders in Singer, too, like Meltano, and all the self-hosters.

The GitHub activity seems robust to me, but I don’t really have any in depth knowledge about the Singer community. Saying it’s “dying” doesn’t seem accurate, though.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#29
post #21

Did you use a particular library for the drag and drop graph building UI? Woukd like to know as I could use something like that for different project

Hey! Yeh I did https://g6.antv.vision/en although I think I might try using this https://x6.antv.vision/en if I could start again. X6 wasn't as well built out when I started though but its probably more suited to my use case with its interaction support. If you have other libraries that serve this purpose let me know because I did a lot of searching and thats the best I found at the time.

Thanks! Looks great, I hadn't heard of it

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#30
post #21

Did you use a particular library for the drag and drop graph building UI? Woukd like to know as I could use something like that for different project

Hey! Yeh I did https://g6.antv.vision/en although I think I might try using this https://x6.antv.vision/en if I could start again. X6 wasn't as well built out when I started though but its probably more suited to my use case with its interaction support. If you have other libraries that serve this purpose let me know because I did a lot of searching and thats the best I found at the time.

Digging around a bit I must say I am very impressed by all the data-viz stuff the antv group makes. Would really like to be able to try out their GraphInsight tool (https://github.com/antvis/GraphInsight/blob/master/README.en...) but it seems to Chinese only for the moment
Post reply on HN