Live data from Hacker News

Show HN: Glue – Pandas as a DAG (Now a web app)

gluedata.io

1–10 of 30 posts

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#2
Hey guys,

I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way.

Since doing that I took a job and am pretty burned out on the project. I was thinking about open sourcing it and seeing if it gets more interest that way. Potentially as a self contained docker image that folks could pull down and run.

Glue is pretty similar to these commercial projects https://www.alteryx.com/, https://www.dataiku.com/, https://parabola.io/ and other DAG based data pipeline generators. I also saw this posted on hackernews within the last year or so https://datablocks.pro/ which is pretty cool too (also more of of an indie project).

Here is the current API. Probably needs some de-scoping so that its only the important endpoints but its a look under the hood if anyone is curious. - https://app.gluedata.io/docs#/

Anyway if anyone has any comments, suggestions / feedback please let me know. Happy to share any details or thoughts.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#4
post #3

Are you aware of AWS Glue? (If nothing else I think its existence will be bad for your SEO/Stack Overflow Optimisation.)

Haha yeh... I have been told the branding / naming is bad for that reason which is fair. If you have ideas I'm all ears ;)

But yeh good points on SEO / stackoverflow.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#7
post #5

What is the expected inputs and outputs? How do you see this fitting into a users workflow?

I'm not totally sure what the question is but currently these are the inputs:

delimited, excel, json, feather, parquet, sqlite, postgresql, mysql, googleSheets

Outputs are the same (excluding databases currently). This is probably the most time consuming piece of the project if I was to expand this set dramatically given the quantity of possible connections, although here is where open source could help.

It's hard to know how technical or not technical to take this. e.g. could there be a python input e.g. arbitrary python script to pull in data? That would allow for basically any input or output. But for non technical users thats a harder sell... open to ideas.

Re: Show HN: Glue – Pandas as a DAG (Now a web app)

#8

Hey guys, I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way. Since doing that I took a job and am pretty burned out on the project. I was…

If you think you were burned out before, becoming an open source maintainer probably won't help :) If I were you I would put out a call for maintainers, and maybe consider a license that keeps modifications open source. That way a company that modifies it will have to contribute back to the project. If you do open source, I recommend moving your roadmap to a GitHub Project, put together a contributors guide/agreement.

Companies will definitely be averse to using a project due to trademark or licensing issues. Apparently somebody is using the name (https://alter.com/trademarks/glue-85698439). You could probably find a way to signify your use is distinctive from that other one, and you may want to register it to protect it. IANAL.

I think it has a lot of potential, but finding people who want to build it out/run the project will be the challenge.

Post reply on HN