Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open Source Python ETL

amphi.ai

Post reply on HN
Print view View original

121–127 of 127 posts

Re: Open Source Python ETL

#121

Post by hermitcrab »

morkalork wrote: post #118
hermitcrab wrote: post #95

Earlier quoted context omitted.

So if Bob from accounts needs a new report generating, he has to wait for 6 month for an IT guy to do it? Who probably won't do a very good job, because he doesn't understand what Bob needs as well as Bob does? Bob is going to hack something horrific together in Excel instead. Better surely to let Bob have a GUI point and click tool more appropriate to the job?

On the other hand, Bob keeps asking for a self-serve reporting tool but in my experience, he doesn't actually want to use it. We went the route of putting all the data into a lake and hooking up GUI reporting tools to it and what did we get? Bob doesn't understand this or that column, Bob made a report that is fundamentally flawed, Bob sent a request for the engineers to make him a report using the tool and so on. Bo…

>On the other hand, Bob keeps asking for a self-serve reporting tool but in my experience, he doesn't actually want to use it.

Bob can't have it both ways. ;0)

>So why not let engineers use the tools they prefer?

Empowering end-users shouldn't mean forcing engineers to use the same tools, against their will.

Re: Open Source Python ETL

#122

Post by isjamesalive »

OutOfHere wrote: post #109
thibautdr wrote: post #3

Hi everyone, thanks for posting Amphi :) To give some context, Amphi is a low-code ETL tool for both structured and unstructured data. The key use cases include file integration, data preparation, data migration, and creating data pipelines for AI tasks like data extraction and RAG. What sets it apart from traditional ETL tools is that it generates Python code that you own and can deploy anywhere. Amphi is available…

You know what does not set it apart? AI-washing. Also, lying about being open source when it isn't.

To be fair, the only place the words ‘open’ and ‘source‘ appear in the readme are once in a sub-heading, where it’s phrased ‘open-source’. It’s clearly labelled ELv2.

Possibly more of a subtle miscommunication or misunderstanding than a deliberate lie.

Re: Open Source Python ETL

#123

Post by OutOfHere »

isjamesalive wrote: post #122
OutOfHere wrote: post #109

Earlier quoted context omitted.

You know what does not set it apart? AI-washing. Also, lying about being open source when it isn't.

To be fair, the only place the words ‘open’ and ‘source‘ appear in the readme are once in a sub-heading, where it’s phrased ‘open-source’. It’s clearly labelled ELv2. Possibly more of a subtle miscommunication or misunderstanding than a deliberate lie.

Don't kid yourself. The title of this submission itself starts with "Open Source". Moreover, the author has made the explicit decision to not fix the readme.

Re: Open Source Python ETL

#124

Post by pelasaco »

hermitcrab wrote: post #95
ic_fly2 wrote: post #13

With all the data issues strong quality and normalisation I often get the impression that enabling more people with non CS backgrounds to do this work is not necessarily a good thing. In other words, if writing python and sql is the skill requirement that stops you from making an etl pipeline, maybe do something else.

So if Bob from accounts needs a new report generating, he has to wait for 6 month for an IT guy to do it? Who probably won't do a very good job, because he doesn't understand what Bob needs as well as Bob does? Bob is going to hack something horrific together in Excel instead. Better surely to let Bob have a GUI point and click tool more appropriate to the job?

Bob doesn't write a specification, because Bob doesn't know as well what he wants. He will have to explore, try out until he reaches something that he can work with. Nobody is willing to spend time planning and documenting stuff. Everyone feels one youtube away from being expert in software development.

Re: Open Source Python ETL

#125

Post by johhns4 »

thibautdr wrote: post #103
johhns4 wrote: post #59

Earlier quoted context omitted.

Wow amazing work! How does the inputs work, are they created for you or does it support custom as well?

Thank you! Inputs components are pre-built for now but the ability to add custom inputs is coming soon!

Do please say when this will work as this could make my workflows a lot easier to visualize and work with.

Re: Open Source Python ETL

#127

Post by thibautdr »

johhns4 wrote: post #125
thibautdr wrote: post #103

Earlier quoted context omitted.

Thank you! Inputs components are pre-built for now but the ability to add custom inputs is coming soon!

Do please say when this will work as this could make my workflows a lot easier to visualize and work with.

I sure will!
Post reply on HN