F1 Query: Declarative Querying at Google Scale [pdf]

#1

Post by anuragbiyani » Wed, Aug 08, 2018, 10:03 PM UTC

F1 Query: Declarative Querying at Google Scale [pdf]
vldb.org

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#2

Post by learning2write » Thu, Aug 09, 2018, 1:02 AM UTC

Related Reading (FB Equivalent): https://www.facebook.com/notes/facebook-engineering/presto-i...

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#3

Post by ebikelaw » Thu, Aug 09, 2018, 2:46 AM UTC

learning2write wrote: post #2

Related Reading (FB Equivalent): https://www.facebook.com/notes/facebook-engineering/presto-i...

30000 queries per day, and 550000 queries per second seem like two radically different things.

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#4

Post by learning2write » Thu, Aug 09, 2018, 4:14 AM UTC

ebikelaw wrote: post #3

learning2write wrote: post #2

Related Reading (FB Equivalent): https://www.facebook.com/notes/facebook-engineering/presto-i...

30000 queries per day, and 550000 queries per second seem like two radically different things.

That number was from 2013. Don't underestimate exponential growth :)

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#5

Post by willemave » Thu, Aug 09, 2018, 5:14 AM UTC

I read this as we have so many query / data platforms so we're going to build another query standard to standardize all the query languages. Just another flavor of the standards problem.

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#6

Post by utopcell » Thu, Aug 09, 2018, 5:20 AM UTC

willemave wrote: post #5

I read this as we have so many query / data platforms so we're going to build another query standard to standardize all the query languages. Just another flavor of the standards problem.

I see F1 as: ``what is the largest SQL subset we can support without compromising scalability.''

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#7

Post by mk926 » Thu, Aug 09, 2018, 6:16 AM UTC

What's relation with BigQuery?

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#8

Post by azurezyq » Thu, Aug 09, 2018, 7:28 AM UTC

mk926 wrote: post #7

What's relation with BigQuery?

Bq is based on Dremel, which is for data warehouse, not facing user traffic. You can find the original paper for Dremel easily.

Re: F1 Query: Declarative Querying at Google Scale [pdf]

#9

Post by azurezyq » Thu, Aug 09, 2018, 7:30 AM UTC

learning2write wrote: post #2

Related Reading (FB Equivalent): https://www.facebook.com/notes/facebook-engineering/presto-i...

This is for offline data analysis, more like Google's bigquery / Dremel. They are different things.