Live data from Hacker News

Searching the web for under $1000/month

quickwit.io

51–60 of 153 posts

Re: Searching the web for under $1000/month

#51

Earlier quoted context omitted.

Depending on the requirements https://www.hetzner.com/dedicated-rootserver/ax101/ May be an actually better fit Once they available again

Why a Ryzen instead of an Epyc in a data center?

b/c it's a cheap hoster. they use a lot of desktop cpu's.

afaik their most popular product is the EX4x line with a i7-6700.

Re: Searching the web for under $1000/month

#52

It is a cool project. S3 can be cost efficient, but only if you don't touch data :) Their price calculation doesn't mention cost of S3 requests, which very quickly adds up and is often neglected. It costs $1 for 2.5M GET requests to S3. They have 180 shards, in a general case query seems to fetch all of them. Presumably they don't download full shard per request, but download an index + some relevant ranges. Lets say…

For what it's worth, if you want to run ElasticSearch on AWS I would always go with local-NVMe instances from the i3 family, this is also what AWS and Elasticsearch themselves recommend.

4x i3en.2xlarge (64GB / 5TB NVMe) at $449 / month (1yr reserved) is $1796, or $2636 without reservation, but much better performance due to the NVMe drives.

Re: Searching the web for under $1000/month

#53
post #34

Earlier quoted context omitted.

Depending on the requirements https://www.hetzner.com/dedicated-rootserver/ax101/ May be an actually better fit Once they available again

Holy smokes. 8TB SSD + 128GB RAM + Ryzen 9 for 100 euro a month. Can you get anywhere close to this with AWS or even DO?

On AWS you can't get 128GB RAM on anything for less than $300/month (or nearly $500 on-demand). And to get multiple TB of SSD you need significantly larger instances, north of $1000/month.

Similar with DO, the closest equivalent is a 3.52GB SSD, 128GB RAM, 16 vCPU droplet for $1240/month.

If you need raw power instead of integration into an extensive service ecosystem, dedicated servers are hard to beat (short of colocating your own hardware, which comes with more headache). And Hetzner is among the best in terms of value/money.

Re: Searching the web for under $1000/month

#54

If you're going for low cost, you could do better: https://www.hetzner.com/dedicated-rootserver/dell/dx181/conf... Basic configuration in Finland 1 224,91 € 1.92 TB SATA SSD Datacenter Edition 4 95,20 € 320,11 € 320 Euro equals 385.90 United States Dollar

This is a complex misunderstanding... First, we are getting better throughput from S3 than I we were using a SATA SSD. (and slower than a NVMe SSD). This is a bit of a secret. Of course, single sequential throughput on S3 sucks. At the end of the day the data is stored on spining disk and we cannot do anything against the law physics. ... but we can concurrently read many disks using s3. Network is our only bottlenec…

How about setting up minio on these hertzner setups? You get benefit of s3 on cheap hardware without aws costs

Re: Searching the web for under $1000/month

#56
post #35
post #34

Earlier quoted context omitted.

Holy smokes. 8TB SSD + 128GB RAM + Ryzen 9 for 100 euro a month. Can you get anywhere close to this with AWS or even DO?

Of course not. But that's why the "cloud" (as in the typical DO/AWS/Azure/GCP offerings) are a scam.

Huge fan of Hetzner, but dedicated servers do not invalidate the value proposition of the cloud.

Ordering a server at Hetzner can take anywhere between a few minutes and a few days. Each server has a fixed setup cost of around the monthly rent. They only have two datacenters in Europe. They don't have any auxillary services (databases, queues, scalable object storage, etc.). They are unbeatable for certain use-cases, but the cloud is still valuable for lots of other scenarios.

Re: Searching the web for under $1000/month

#57

If you're going for low cost, you could do better: https://www.hetzner.com/dedicated-rootserver/dell/dx181/conf... Basic configuration in Finland 1 224,91 € 1.92 TB SATA SSD Datacenter Edition 4 95,20 € 320,11 € 320 Euro equals 385.90 United States Dollar

Depending on the requirements https://www.hetzner.com/dedicated-rootserver/ax101/ May be an actually better fit Once they available again

The value for money that Hetzner offer is just mind boggling.

Re: Searching the web for under $1000/month

#58
post #18

Is it a web search engine or an adjective search engine? I'd love to see someone make a deep search engine that goes beyond the 100...1000 limit.

It is a web search engine. As explained in the blog post, we made the demo by generating 18k snippets and pushing them to a NLP pipeline that tries to extract the adjective phrase.

The tech below is an inverted index.

Re: Searching the web for under $1000/month

#60
post #48

If you're going for low cost, you could do better: https://www.hetzner.com/dedicated-rootserver/dell/dx181/conf... Basic configuration in Finland 1 224,91 € 1.92 TB SATA SSD Datacenter Edition 4 95,20 € 320,11 € 320 Euro equals 385.90 United States Dollar

I am really starting to feel that co-location will make a big comeback. It seems cloud costs are just becoming too high for the convenience they once offered. For small projects and scale probably makes a ton of sense, but at some point the costs to scale aren't worth the up front developer cost savings.

It depends on the use case does not it.

Shared nothing is the best architecture for e-commerce search for instance.

But if you have one query every minutes or so for a 1TB dataset, it feels a bit silly to have a couple of servers dedicated to it doesn't it? Imagine this is the case for all big data search you can think of... Logs, emails, etc. This is a waste of CPU and RAM.

Post reply on HN