Live data from Hacker News

Airbnb open-sources Caravel: data exploration and visualization platform

github.com

31–40 of 95 posts

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#31

I really need a great data explorer/dashboard for my postgres-based systems. I was going to use shiny but this looks really nice -- I hope the docs can be built out very soon. Can anyone comment on other competing products? In the commercial space, I like Looker but its too pricey.

Take a look at http://www.viurdata.com Simple to use product, with transparent pricing and you can use drag & drop or add your own SQL Queries.

Disclaimer: I am one of the founders.

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#32

If anyone involved with this is around, I'm curious why Airbnb would build something like this - cost, performance, features, all of the above? Data querying and visualization is a pretty crowded field with a lot of commercial options to choose from[1]. I'm not knocking Caravel (it looks amazing) just curious why build vs buy in this case. [1] Tableau, Looker, Periscope, Chartio, Qlikview, Gooddata are just some that…

I am pretty sure they used multiple (and then most likely at some point too many) of those tools

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#33

If anyone involved with this is around, I'm curious why Airbnb would build something like this - cost, performance, features, all of the above? Data querying and visualization is a pretty crowded field with a lot of commercial options to choose from[1]. I'm not knocking Caravel (it looks amazing) just curious why build vs buy in this case. [1] Tableau, Looker, Periscope, Chartio, Qlikview, Gooddata are just some that…

Can't speak for Airbnb, but I'm not sure that any of the front-end clients that you mentioned (disclosure: I work at Looker), can talk to Druid. So if Airbnb already had a Druid warehouse in place, they may have decided it was easier to roll their own front-end than migrate to a different backend.

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#34
post #30

If anyone involved with this is around, I'm curious why Airbnb would build something like this - cost, performance, features, all of the above? Data querying and visualization is a pretty crowded field with a lot of commercial options to choose from[1]. I'm not knocking Caravel (it looks amazing) just curious why build vs buy in this case. [1] Tableau, Looker, Periscope, Chartio, Qlikview, Gooddata are just some that…

They mention that it was originally paired with Druid. The data volume that Druid excels at (and that AirBnB must have) is orders of magnitude larger than what Tableau&Looker do well with. It's probably just built for bigger-than-SQL OLAP usecases.

Looker scales with plenty of data for us at Snapchat, it's more about the underlying database than the BI tool.

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#36

I really need a great data explorer/dashboard for my postgres-based systems. I was going to use shiny but this looks really nice -- I hope the docs can be built out very soon. Can anyone comment on other competing products? In the commercial space, I like Looker but its too pricey.

Really depends on your needs. There are lots of options out there that are happy to talk to Postgres, but each has different strengths and weaknesses. If all you need is a way to basically share and visualize the output of SQL queries and everyone who's using the tool can write SQL well, then look at Periscope or Mode.

If you're ok pulling the data out of Postgres into memory locally and mostly care about manipulation and beautiful dataviz, then look at Tableau.

If you're mostly interested in more data sciency/ML stuff, then Shiny or something else that's R-based is a good option.

If you're interested in being able to embed your business logic into the tool so that non-SQL folks can build their own queries and everybody's relying on the same data definitions, that's where Looker (disclosure: where I work) excels.

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#37
post #16

seems a little bit sparse on the documentation or am I missing something?

We'll be providing short user training videos very soon.

Would very much appreciate that as well as walk-through docs.

Got it up and running easily enough, and connected to Redshift. But seemed like creating a new "slice" required custom JSON params to define it. Unless I missed something?

edit: yep, missed something. Can "explore" a table by clicking it's link in the table listing.

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#38
post #30

If anyone involved with this is around, I'm curious why Airbnb would build something like this - cost, performance, features, all of the above? Data querying and visualization is a pretty crowded field with a lot of commercial options to choose from[1]. I'm not knocking Caravel (it looks amazing) just curious why build vs buy in this case. [1] Tableau, Looker, Periscope, Chartio, Qlikview, Gooddata are just some that…

They mention that it was originally paired with Druid. The data volume that Druid excels at (and that AirBnB must have) is orders of magnitude larger than what Tableau&Looker do well with. It's probably just built for bigger-than-SQL OLAP usecases.

It's worth distinguishing between the tools that leave the data in your data warehouse (Caravel, Periscope, Mode, Looker (where I work)), and those that have their own data stores (Good Data, Qlikview, etc.) Tableau can connect directly to your datastore, but it's happier if it can operate on data that's stored locally in-memory.

Anyway, the ones where bring your own database can scale as far as the database can bring you.

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#39
post #35

The code is so clean and simple. This is great PR for the company. I want to work there.

Not from the number of lines of code. Some of them exceeds 1000.

# of lines does not indicate good or poor coding

Re: Airbnb open-sources Caravel: data exploration and visualization platform

#40

I really need a great data explorer/dashboard for my postgres-based systems. I was going to use shiny but this looks really nice -- I hope the docs can be built out very soon. Can anyone comment on other competing products? In the commercial space, I like Looker but its too pricey.

Take a look to http://www.metabase.com/ (open source, made by Expa, Uber's co-founder incubator).

Second this recommendation. Very easy to get up and running - may not be able to handle some complex use cases, but for the basics it's fantastic.
Post reply on HN