Show HN: Glue – Pandas as a DAG (Now a web app)
1–10 of 30 posts
Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#2I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way.
Since doing that I took a job and am pretty burned out on the project. I was thinking about open sourcing it and seeing if it gets more interest that way. Potentially as a self contained docker image that folks could pull down and run.
Glue is pretty similar to these commercial projects https://www.alteryx.com/, https://www.dataiku.com/, https://parabola.io/ and other DAG based data pipeline generators. I also saw this posted on hackernews within the last year or so https://datablocks.pro/ which is pretty cool too (also more of of an indie project).
Here is the current API. Probably needs some de-scoping so that its only the important endpoints but its a look under the hood if anyone is curious. - https://app.gluedata.io/docs#/
Anyway if anyone has any comments, suggestions / feedback please let me know. Happy to share any details or thoughts.
Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#3(If nothing else I think its existence will be bad for your SEO/Stack Overflow Optimisation.)
Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#4Are you aware of AWS Glue? (If nothing else I think its existence will be bad for your SEO/Stack Overflow Optimisation.)
But yeh good points on SEO / stackoverflow.
Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#5Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#6What is the expected inputs and outputs? How do you see this fitting into a users workflow?
Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#7What is the expected inputs and outputs? How do you see this fitting into a users workflow?
delimited, excel, json, feather, parquet, sqlite, postgresql, mysql, googleSheets
Outputs are the same (excluding databases currently). This is probably the most time consuming piece of the project if I was to expand this set dramatically given the quantity of possible connections, although here is where open source could help.
It's hard to know how technical or not technical to take this. e.g. could there be a python input e.g. arbitrary python script to pull in data? That would allow for basically any input or output. But for non technical users thats a harder sell... open to ideas.
Re: Show HN: Glue – Pandas as a DAG (Now a web app)
#8Hey guys, I posted this maybe a year ago. It was originally an electron based desktop app which was cool but pretty hard to maintain / get people to download and test it out. Given that there would likely always need to be a cloud component regardless I decided that it would be easier to port it over into a web app and maintain it that way. Since doing that I took a job and am pretty burned out on the project. I was…
Companies will definitely be averse to using a project due to trademark or licensing issues. Apparently somebody is using the name (https://alter.com/trademarks/glue-85698439). You could probably find a way to signify your use is distinctive from that other one, and you may want to register it to protect it. IANAL.
I think it has a lot of potential, but finding people who want to build it out/run the project will be the challenge.