Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

aws.typepad.com

Post reply on HN
Print view View original

51–60 of 91 posts

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#51

Post by shingen »

lobster_johnson wrote: post #50
Mikushi wrote: post #42

Earlier quoted context omitted.

And if you want an actually good search product there is always SphinxSearch.

Last I checked, Sphinx had a huge design flaw in that it indexed directly from an SQL database. In other words, your Sphinx configuration not only needs to have read access to the database, it needs to contain the required SQL queries. This tightly couples Sphinx to your application and your schema, and creates serious issues for your ops team since every app change potentially needs to modify the Sphinx config. It g…

That's incorrect. Sphinx can index documents and does not require an SQL database. Such has been the case for a few years now.

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#52

Post by Terretta »

intended wrote: post #3

looks like some people would want help in converting document X into a - "JSON or XML that conforms to our Search Document Format (SDF)" This is still going to be a painfull task for legacy data - it has to be massaged into shape. Should be interesting to see how this gets applied though.

That doesn't seem to be included in the "in an hour" part of the process.

I can see a lot of small businesses with S3 tools on the desktop getting excited about the ability to search their office document store, then discovering there's a whole lot of programming to do first.

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#53

Post by [deleted] »

cmiles74 wrote: post #48
Mikushi wrote: post #42

Earlier quoted context omitted.

And if you want an actually good search product there is always SphinxSearch.

Why the bashing on Elasticsearch? We are using it to index log files; we have over 275 million documents in our index and performance has been pretty impressive.

[deleted]

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#54

Post by JohnGolt »

Mikushi wrote: post #42
rb2k_ wrote: post #31

Earlier quoted context omitted.

And if you want a hassle free scalable search service with automatic sharding/scaling, a lucene underpinning and a nice REST API: Elasticsearch

And if you want an actually good search product there is always SphinxSearch.

That's why you could look at IndexDen.com which powered by Sphinx Search cluster :)

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#55

Post by [deleted] »

lobster_johnson wrote: post #50
Mikushi wrote: post #42

Earlier quoted context omitted.

And if you want an actually good search product there is always SphinxSearch.

Last I checked, Sphinx had a huge design flaw in that it indexed directly from an SQL database. In other words, your Sphinx configuration not only needs to have read access to the database, it needs to contain the required SQL queries. This tightly couples Sphinx to your application and your schema, and creates serious issues for your ops team since every app change potentially needs to modify the Sphinx config. It g…

[deleted]

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#56

Post by paulsmith »

lobster_johnson wrote: post #50
Mikushi wrote: post #42

Earlier quoted context omitted.

And if you want an actually good search product there is always SphinxSearch.

Last I checked, Sphinx had a huge design flaw in that it indexed directly from an SQL database. In other words, your Sphinx configuration not only needs to have read access to the database, it needs to contain the required SQL queries. This tightly couples Sphinx to your application and your schema, and creates serious issues for your ops team since every app change potentially needs to modify the Sphinx config. It g…

That's not true, you can pipe in data from any source:

http://sphinxsearch.com/docs/2.0.4/xmlpipe2.html

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#57

Post by peyton »

aphexairlines wrote: post #23
hboon wrote: post #19

Earlier quoted context omitted.

Just like they said AWS is the infrastructure that powers Amazon when AWS started out. I'd read this with a pinch of salt.

Amazon never claimed this.

Here's the initial announcement of EC2: http://aws.amazon.com/about-aws/whats-new/2006/08/24/announc...

> run on Amazon’s proven computing environment

Yes, Amazon never explicitly stated, "We run our site on a fleet of EC2 instances, and you should too," but they certainly weaseled a connection with their main site that didn't exist.

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#58

Post by cpg »

Theoretical, fun, exercise for the reader: How much would it cost in AWS fees to index the same amount as Google and make it available to search?

The answer is in two parts: 1) "fixed" cost to upload the data (say in one shot) and 2) the hourly/daily/monthly) cost to make these search instances running.

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#59

Post by nickm12 »

edouard1234567 wrote: post #28
zargath wrote: post #17

interesting, I will check out for sure. Any plans for EU release? I am very interested in the facet-search functionality, anybody know if there is sort options on the returned facet's ? Most search engines just sort facets by number of hits.

You can sort facets in your application, not sure why you'd want the search engine to sort them, doesn't seem like a feature that belongs to the "back-end" search engine.

If you want to sort by anything other than the number of hits in every facet, then there is information about the facets that only the search engine really knows. For instance, which facet holds the most relevant results?

Re: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

#60

Post by nickm12 »

mryan wrote: post #10
joshu wrote: post #5

anyone know what it is underneath the covers? elasticsearch?

It says it is based on the same search that powers Amazon.com, so presumably it is A9: http://a9.com/

The A9 website says "Developed by A9, Amazon CloudSearch is built with the same innovative technology that powers search for Amazon.com."
Post reply on HN