Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
1–10 of 39 posts
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#2I wonder if this makes BI companies freak out a little bit -- because pushing this data into redshift and adding a visualization layer on top takes care of most smaller scale BI needs...
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#3I wonder if this makes BI companies freak out a little bit -- because pushing this data into redshift and adding a visualization layer on top takes care of most smaller scale BI needs...
Actually, we don't have any interest in being a visualization tool, and are super focused on building customer data infrastructure of the future.
This product release is in close partnership with our BI partners (Looker, Mode, Wagon, Periscope, BIME and Chartio). One of the biggest problems our mutual customers face is getting data into their warehouse so that they can use the BI tool in the first place. This launch significantly expands the possible audience for them.
Even better, all of our BI partners built out-of-the-box reporting and dashboards based on Segment's schemas for these new third party sources. So our mutual customers can get set up even faster.
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#4Is this just running the SF SoQL statement for you and storing the aggregated result in a Segment table?
Or does Segment provide a way to completely clone entire SF tables such as Opportunities & Cases and then create the aggregate queries later in segment?
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#5I wonder if this makes BI companies freak out a little bit -- because pushing this data into redshift and adding a visualization layer on top takes care of most smaller scale BI needs...
The BI space is absurd. BI viz is the photo apps of the b2b world. Everyone and their grandma thinks they can make one. Lots of VC money gonna get burned.
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#6I wonder if this makes BI companies freak out a little bit -- because pushing this data into redshift and adding a visualization layer on top takes care of most smaller scale BI needs...
Actually, we don't have any interest in being a visualization tool, and are super focused on building customer data infrastructure of the future. This product release is in close partnership with our BI partners (Looker, Mode, Wagon, Periscope, BIME and Chartio). One of the biggest problems our mutual customers face is getting data into their warehouse so that they can use the BI tool in the first place. This launch…
Hey pkrein, I am a Segment fan and startup-scale user of your warehouse service. The warehouse service is super convenient, but its main shortfall for us is that you don't offer historical backfilling of data more than 60 days before the warehouse was enabled. That is the data we need in our warehouse most.
There are other ways to load in Salesforce, Zendesk, or Stripe data. It is certainly nice to be able to do that all with Segment -- but it is not necessary. Sources is nice to have, but the core warehouse service is not really complete (for us, and I suspect others too) until you can seamlessly support data backfill at all price tiers. A one-time fee for backfill fee would be okay, but saying "no we don't support that" makes me sad.
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#7Earlier quoted context omitted.
Actually, we don't have any interest in being a visualization tool, and are super focused on building customer data infrastructure of the future. This product release is in close partnership with our BI partners (Looker, Mode, Wagon, Periscope, BIME and Chartio). One of the biggest problems our mutual customers face is getting data into their warehouse so that they can use the BI tool in the first place. This launch…
Hey pkrein, I am a Segment fan and startup-scale user of your warehouse service. The warehouse service is super convenient, but its main shortfall for us is that you don't offer historical backfilling of data more than 60 days before the warehouse was enabled. That is the data we need in our warehouse most. There are other ways to load in Salesforce, Zendesk, or Stripe data. It is certainly nice to be able to do that…
Yep, as part of this launch we've revised our pricing. If you commit to an annual plan (even self-service plan) we will load all of your historical data, not just 60 days. Just email friends@segment.com after signing up for the paid annual plan and we'll make it happen on the next sync.
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#8ETL-as-a-Service is a great idea, particularly one that is visualization/analytics-tool-agnostic!
However, there are so many data sources, and they all require different integrations with their different APIs or export mechanisms. A service isn't really useful unless it can import the lion's share of services that a given company uses...
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#9ETL-as-a-Service is a great idea, particularly one that is visualization/analytics-tool-agnostic! However, there are so many data sources, and they all require different integrations with their different APIs or export mechanisms. A service isn't really useful unless it can import the lion's share of services that a given company uses...
You’re right. There are a lot of sources out there. It’s a ton of work for companies to build out their own pipelines and learn every new API. We want to save them from that burden so that they can focus on the analysis. We’ll be adding many more connections in the coming weeks and months, and also opening up the platform for cloud services to add themselves. Stay tuned!
Re: Segment Sources – Load Salesforce, Zendesk, Stripe into Redshift and Postgres
#10Is this just running the SF SoQL statement for you and storing the aggregated result in a Segment table? Or does Segment provide a way to completely clone entire SF tables such as Opportunities & Cases and then create the aggregate queries later in segment?
Great question! When you enable a source, we begin running a job on an interval for you that pulls the data from the source, applies some light normalizations and transformations, and sends the data to our Object API (which is in charge of upserting the data into Segment and flushing it to your warehouse).
In Salesforce's case, we issue bulk queries to pull the complete collection on the first run, then modify the queries thereafter to request only data that's changed since the last run.
We don't do any aggregation of the data. We load it into a data warehouse (redshift or postgres) in its complete, raw form so that you can use SQL to aggregate/join to your heart's content. Here's an example: https://help.segment.com/hc/en-us/articles/208215583-Salesfo...