Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Real-Time Full-Text Search with Luwak and Samza

blog.confluent.io

Post reply on HN
Print view View original

1–10 of 31 posts

Re: Real-Time Full-Text Search with Luwak and Samza

#4

Post by rb2k_ »

vosper wrote: post #3

I think this is the first post I've seen about Samza from a non-LinkedIn team. I'd love to hear any details about the Samza experience - it seems like it should be the logical choice for Kafka users, but there's not much out there about it.

I don't think Confluent really counts as "non-LinkedIn team" :)

"Jay is co-founder and CEO at Confluent. Prior to Confluent, Jay Kreps was the initial developer on several open source projects, including Apache Kafka, Apache Samza, Voldemort. He was the lead architect for data infrastructure at LinkedIn."

(Martin Kleppmann also has a LinkedIn background)

Re: Real-Time Full-Text Search with Luwak and Samza

#7

Post by vosper »

rb2k_ wrote: post #4
vosper wrote: post #3

I think this is the first post I've seen about Samza from a non-LinkedIn team. I'd love to hear any details about the Samza experience - it seems like it should be the logical choice for Kafka users, but there's not much out there about it.

I don't think Confluent really counts as "non-LinkedIn team" :) "Jay is co-founder and CEO at Confluent. Prior to Confluent, Jay Kreps was the initial developer on several open source projects, including Apache Kafka, Apache Samza, Voldemort. He was the lead architect for data infrastructure at LinkedIn." (Martin Kleppmann also has a LinkedIn background)

Ahh, thanks - I checked that the speakers weren't currently working for LinkedIn, but I didn't look further into their backgrounds.

Oh, well. I still hope to one day read about someone else using Samza in production.

Re: Real-Time Full-Text Search with Luwak and Samza

#8

Post by huskyr »

Bit offtopic, but does anyone have suggestions for simple full text search engines? I basically want something for names, just a couple of thousand, nothing fancy. Setting up something like ElasticSearch seems like overkill (and is quite hungry for specs as well). I was thinking about simply hacking something together with Redis and Python, but i suppose someone might have a better solution.

Re: Real-Time Full-Text Search with Luwak and Samza

#9

Post by martinkl »

vosper wrote: post #7
rb2k_ wrote: post #4

Earlier quoted context omitted.

I don't think Confluent really counts as "non-LinkedIn team" :) "Jay is co-founder and CEO at Confluent. Prior to Confluent, Jay Kreps was the initial developer on several open source projects, including Apache Kafka, Apache Samza, Voldemort. He was the lead architect for data infrastructure at LinkedIn." (Martin Kleppmann also has a LinkedIn background)

Ahh, thanks - I checked that the speakers weren't currently working for LinkedIn, but I didn't look further into their backgrounds. Oh, well. I still hope to one day read about someone else using Samza in production.

Here are a few production users: https://cwiki.apache.org/confluence/display/SAMZA/Powered+By

The Metamarkets team wrote a nice post on their use of Samza a few days ago: https://metamarkets.com/2015/simplicity-stability-and-transp...

Re: Real-Time Full-Text Search with Luwak and Samza

#10

Post by ddorian43 »

huskyr wrote: post #8

Bit offtopic, but does anyone have suggestions for simple full text search engines? I basically want something for names, just a couple of thousand, nothing fancy. Setting up something like ElasticSearch seems like overkill (and is quite hungry for specs as well). I was thinking about simply hacking something together with Redis and Python, but i suppose someone might have a better solution.

Python has a search-engine: whoosh
Post reply on HN