Live data from Hacker News

Amazon AppFlow

aws.amazon.com

51–60 of 112 posts

Re: Amazon AppFlow

#51
Related, I've been trying to figure out what the best way to populate a Redshift database from regularly updated SFTP sources is and I can't quite figure it out. AWS Glue? A function in Lambda? This?

AWS presents so many options that it's a bit overwhelming.

Re: Amazon AppFlow

#52

Really curious how well the salesforce integration works. Heroku has a product that does this (Heroku Connect), but it doesn't work well with large tables and you have to pay them an obscene amount of money to even properly test it (which might have something to do with them being owned by Salesforce). So many companies with tons of data trapped in Salesforce's expensive walled garden and no way to get it out. Dumpin…

Couldn't agree more. This is obviously a shameless plug but we built a product (getcensus.com) specifically focused on this problem of getting data to/from Salesforce & data warehouses (not just Redshift).

Heroku Connect is pretty powerful but not only is it super expensive as you point out but also forces you into creating an extra layer in the stack by creating a Heroku Postgres DB. The secret advantage of Connect is that since it's owned by Salesforce it bypasses Salesforce API quotas but that's a whole other can of worms :-)

Re: Amazon AppFlow

#53

Noob here with a question - is this in any way a competitor product to Segment?

Yes and no. It's primarily focused on centralizing data into a data warehouse / data lake rather than sending data out to other apps. Segment also pushes events into a warehouse but most of its functionality is about forwarding events to 3rd party apps. That said, you can use tools like getcensus.com to move data/events from an AWS-populated data warehouse back to other apps (disclosure: I'm one of the founders of this service).

Re: Amazon AppFlow

#54

Related, I've been trying to figure out what the best way to populate a Redshift database from regularly updated SFTP sources is and I can't quite figure it out. AWS Glue? A function in Lambda? This? AWS presents so many options that it's a bit overwhelming.

Maybe some aws bash?

Re: Amazon AppFlow

#55
I really wonder about all these services that eat into the layers of implementation that organisations usually do in house, but at the same time quick form a complex web of lock in that prevents you ever leaving Amazon. It seems to me that these services are very seductive but there are very few cases where it's truly in an organisation's long term interest to adopt them. At best, use them as a quick interim solution to bootstrap what you are building and then use that as your requirements for an open source or at least vendor-neutral equivalent.

Curious what the HN crowd thinks about this issue?

Re: Amazon AppFlow

#56
> Automate data back ups

This has always killed me about SaaS-es that don't provide any decent method for backups (and less so: restores), especially for data modifications (eg, accidental deletions) that there's no ability to rollback.

Re: Amazon AppFlow

#57

Really curious how well the salesforce integration works. Heroku has a product that does this (Heroku Connect), but it doesn't work well with large tables and you have to pay them an obscene amount of money to even properly test it (which might have something to do with them being owned by Salesforce). So many companies with tons of data trapped in Salesforce's expensive walled garden and no way to get it out. Dumpin…

Not affiliated but have used it: Stitch Data.

Re: Amazon AppFlow

#58
post #9

This seems like a Zapier killer, makes sense.

"Killer" - No.

90% of the market for Zapier is people who have no technical knowledge. Those people won't be jumping on AWS any time soon.

Obviously pulling the 90% out of my ass, but I'm heavy Zapier user for my e-commerce business. I have (Or had - Haven't renewed as e-com has replaced my DevOps income) multiple AWS certs and I'd still much prefer Zapier over this. Especially when you can run custom code on Zapier for more complex cases anyway.

Re: Amazon AppFlow

#59

Earlier quoted context omitted.

What are some good Jira alternatives? We use Trello, but it's limited and plugins are needed for everything.

Answer really depends on the size & culture of the organization. Clubhouse.io, Asana & PivotalTracker are nice, but a little opinionated (can be a good or bad thing depending on who you are :) ). I think where Jira really rubs people the wrong way is it's speed, particularly after someone customized it with a byzantine workflow or with dozens of views/reports and no primary source of truth for the team to use. Imagin…

> but a little opinionated

That’s exactly the problem with Jira (and honestly Bugzilla in the same way a decade ago), it tries to please everyone and thus succeeds with no one. Trying to do everything typically ends up in bloat/complication/slowness, which seems to happen disproportionately for bug tracking and cms systems.

Re: Amazon AppFlow

#60
post #49

Earlier quoted context omitted.

What are some good Jira alternatives? We use Trello, but it's limited and plugins are needed for everything.

Trello's the one that rolls random people's personal accounts into the account of the business they work for, right? And refuses to give them back when asked?

I don't think I've experienced this issue.
Post reply on HN