Live data from Hacker News

Ask HN: $8k on AWS in August for you, any interesting computations?

news.ycombinator.com

31–40 of 94 posts

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#31
post #27

You could spin up a large number of ArchiveTeam warrior images

If I get this correctly, this would help make a backup of archive.org. It would download a big amount of data and then store it for... one month, until the instances expire? That seems rather wasteful of bandwidth and effort, or am I missing the point?

That's a separate AT project. The Warrior downloads data from various websites (usually ones that look like they're about to go down) and uploads the data to a central AT server. It's distributed to get around rate-limiting and banning. Data is not stored long-term on the Warrior.

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#33
If you are into baseball and advanced sabermetric stats, there's a bunch of c3.8XL and g2.8XL instances out there cranking through data to train various neural networks. The results can't be published to the public but I'd be happy to add you to the distribution list of results and future projections.

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#34
I am doing my thesis (in the general area of video classification) as an electrical engineer in a Greek University and I am currently running some experiments that try to learn a video representation from local features (kernel codebook encoding) using an SVM variant and stochastic gradient descent.

I could use a couple of c4.8xlarge instances to run the experiments trying out learning parameters. I am currently "competing" for time in the lab's cluster so I end up running the experiments in whatever computer I find available.

Anyway, thanks for the opportunity, it is really generous of you.

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#35
post #23

Earlier quoted context omitted.

Or Folding at Home for protein folding

That would be a waste since this would contribute very little to F@H. I'm the lead dev at F@H.

I thought F@H was processing dependent?

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#36
Amazon was generous enough to give you the credit trying to help your company, and in general is extremely helpful to the startup community as a whole with AWS credits. Maybe you should just give it back to them so they continue to be so kind in the future.

(On the other hand, the main reason AWS gives out these credits is to get startups hooked on AWS, then charge borderline outrageous prices once the credit is done for, profiting billions) :)

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#38
post #33

If you are into baseball and advanced sabermetric stats, there's a bunch of c3.8XL and g2.8XL instances out there cranking through data to train various neural networks. The results can't be published to the public but I'd be happy to add you to the distribution list of results and future projections.

Hmm? First I've heard of it, and I work in professional baseball and have been active in the SABR community. Can you add me? mike.anon@hotmail.com

Re: Ask HN: $8k on AWS in August for you, any interesting computations?

#40
post #23

Earlier quoted context omitted.

Or Folding at Home for protein folding

That would be a waste since this would contribute very little to F@H. I'm the lead dev at F@H.

Wow, 20,000 GPU cores for 20+ days wouldn't help much?
Post reply on HN