Live data from Hacker News

I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

burla-cloud.github.io

11–20 of 44 posts

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#11
This seems like an advertisement for an open source package

>Scale Python across 1,000 CPUs or GPUs in 1 second. Burla is a high-performance parallel processing library with an extremely fast developer experience. Scale batch processing, vector embeddings, inference, or build pipelines with dynamic hardware.

Edit: Author comment was flagged dead. They work at burla which is a managed cloud service for parallelizing python

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#12
post #11

This seems like an advertisement for an open source package >Scale Python across 1,000 CPUs or GPUs in 1 second. Burla is a high-performance parallel processing library with an extremely fast developer experience. Scale batch processing, vector embeddings, inference, or build pipelines with dynamic hardware. Edit: Author comment was flagged dead. They work at burla which is a managed cloud service for parallelizing p…

Looks like it was hit by some sort of automated ChatGPT detector.

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#13
Am I missing something other commenters are seeing about this not being an ad? The domain is on Burla, which hosted the compute needed for this. There's a giant airbnb x burla logo at the top. People are saying there's a lawsuit pending, it's against guidelines, what's the point, etc..

It's content marketing plain and simple for Burla towards people that view this site. It was highly likely done by employees at both Burla and AirBNB together as a joint project.

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#14

Am I missing something other commenters are seeing about this not being an ad? The domain is on Burla, which hosted the compute needed for this. There's a giant airbnb x burla logo at the top. People are saying there's a lawsuit pending, it's against guidelines, what's the point, etc.. It's content marketing plain and simple for Burla towards people that view this site. It was highly likely done by employees at both…

One of the Burla founders here. Not a joint project with Airbnb. I’ve been experimenting with giving agents access to Burla clusters and letting them run with analysis ideas I find interesting. This was one of the results.

The branding is a bit much, fair call, but the intent here was just to explore what these agents can actually build when you give them access to large amounts of compute.

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#16

What a waste of energy (money/resources)... Scraping and AI-scanning 2 million photos to identify animals in the advertisement pictures? What's the point. As an exercise a sample of 1000 photos would've been enough. As a database, knowing a listing has a cat in the picture or a funny review doesn't offer any real value. I wonder what the footprint is of such an exercise.

The pet detection part isn’t the point, that’s just a visible output. The actual goal was to stress test agents + distributed compute on something non-trivial.

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#17
post #7
post #6

"Looking at every public Airbnb listing in Inside Airbnb's open data dump, all at once, on Burla" This Inside Airbnb? Community Guidelines Please: Only take the data you need. Do not scrape data from the site, if you would like to subscribe to the data directly, please email data@insideairbnb.com

>Everything was parallelized on Burla, on a single dynamic cluster that scaled to ~1.7K CPU workers for photo download and CLIP, with 20 A100 GPUs running embedding clusters in parallel on the same cluster. That's a lot of budget - would have been nice if they'd made an actual donation to the project, instead of pounding the project's servers and bandwidth when there are much better ways to interact with the data.

Totally fair callout. I should’ve been more careful here and leaned on the provided datasets / bulk access instead of pulling things at scale. That’s on me.

I’ll make a donation to support the project regardless. Appreciate you raising it.

Re: I scraped 1.94M Airbnb photos for opium dens, pet cameos, and messy kitchens

#18

Am I missing something other commenters are seeing about this not being an ad? The domain is on Burla, which hosted the compute needed for this. There's a giant airbnb x burla logo at the top. People are saying there's a lawsuit pending, it's against guidelines, what's the point, etc.. It's content marketing plain and simple for Burla towards people that view this site. It was highly likely done by employees at both…

One of the Burla founders here. Not a joint project with Airbnb. I’ve been experimenting with giving agents access to Burla clusters and letting them run with analysis ideas I find interesting. This was one of the results. The branding is a bit much, fair call, but the intent here was just to explore what these agents can actually build when you give them access to large amounts of compute.

How many accounts do you have spamming your projects here?
Post reply on HN