Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

JobFunnel, a job website search aggregator

github.com

Post reply on HN
Print view View original

21–30 of 41 posts

Re: JobFunnel, a job website search aggregator

#21

Post by sverhagen »

everdev wrote: post #19
city41 wrote: post #5

I was always under the impression job sites don’t like to be scraped. What are the risks in using a tool like this? I would suspect possibly getting your ip banned.

As always, consult a lawyer. But, my understanding is that you are allowed to scrape sites as long as you don't impact their ability to deliver the site to other users. In other words, don't DDoS them. Sites tried to ban scraping but last I remember seeing it was not enforceable unless it was done at high rates or maliciously. As for content, certain things like recipes aren't protected content because they are "list…

I don't think the question was: "is it legal to scrape", rather: "do they like to be scraped". If they wanted to, I'm sure they could make scraping harder (more annoying). Which, I suppose, thus comes down to: is being aggregated a net plus or minus for their business. Probably "it depends" on what the aggregator does with the data. So, just to get this pun in: it then comes down to: is being aggregated a net plus or minus, IN AGGREGATE.

Re: JobFunnel, a job website search aggregator

#22

Post by sawmurai »

boyinthecloud wrote: post #3

Anyway I can automate applying for a job now. That would be the ultimate tool to complement this.

I work for a job search site and our customers have huge problems with "mass appliers" who just apply to every job and hope that one is an actual fit.

Re: JobFunnel, a job website search aggregator

#24

Post by ddsea »

thenewnewguy wrote: post #20
codingslave wrote: post #14

Earlier quoted context omitted.

This wouldnt be that hard to do, but is it illegal to automate those submissions?

I don't see why it would be, as long as you're just sending one real job application. If you tried to DOS a company by sending in a ton of garbage applications that'd probably be illegal. That said I wouldn't be surprised if you get declined if the company realizes you did so.

Who's with me to automate the coding interview with leetcode problems?

Re: JobFunnel, a job website search aggregator

#25

Post by z3t4 »

sawmurai wrote: post #22
boyinthecloud wrote: post #3

Anyway I can automate applying for a job now. That would be the ultimate tool to complement this.

I work for a job search site and our customers have huge problems with "mass appliers" who just apply to every job and hope that one is an actual fit.

Its not unusual that a dev job get thousands of applications. But what should the job seekers do? If you do the math the work seeker has to apply for 1000 jobs to have a statistical chance to find a match.

The market doesn't work because its unbalanced. For example on a dating site where women do not reach out to men, the women will complain about the low quality, and the men has to mass message. Leading to very few matches.

It the employer would however actively search for candidates the market would be more balanced, and lead to more matches.

The problem is that instead of looking themselves, employers use recruiters. What if there would be recruiters in the dating market. That wouldn't work at all. You would tell the recruiter that you want someone that is intelligent and kind. But you still dont get any matches. Because you dont know what you want until you see it.

Im thinking of like an expo where workers show their skills and portfolios and the employees show what they are working on and the problems they are solving.

Re: JobFunnel, a job website search aggregator

#26

Post by simfoo »

abinaya_rl wrote: post #18

At https://remoteleaf.com , we have been doing this manually to curate remote jobs. I spend more than 6 hours daily searching for, screening, verifying and filtering hundreds of remote jobs. So it can save you time, energy, and frustration – and hopefully, help you find a job faster I'll check out this tool at least for the scrapping part.

When I look at your signup form I can't really find my profession. I had this problem for a while now but maybe I should simply ask: I do industrial software engineering (in my case in automotive) that targets a mixture of embedded, desktop and server environments. This is done mostly in C/C++ with some Python, Shell and maybe Rust. What is the proper profession name for me? Is this a full stack engineer? Not likely from what I've seen but I really don't know

Re: JobFunnel, a job website search aggregator

#27

Post by abinaya_rl »

simfoo wrote: post #26
abinaya_rl wrote: post #18

At https://remoteleaf.com , we have been doing this manually to curate remote jobs. I spend more than 6 hours daily searching for, screening, verifying and filtering hundreds of remote jobs. So it can save you time, energy, and frustration – and hopefully, help you find a job faster I'll check out this tool at least for the scrapping part.

When I look at your signup form I can't really find my profession. I had this problem for a while now but maybe I should simply ask: I do industrial software engineering (in my case in automotive) that targets a mixture of embedded, desktop and server environments. This is done mostly in C/C++ with some Python, Shell and maybe Rust. What is the proper profession name for me? Is this a full stack engineer? Not likely…

I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.

Re: JobFunnel, a job website search aggregator

#29

Post by zo1 »

codingslave wrote: post #14
boyinthecloud wrote: post #3

Anyway I can automate applying for a job now. That would be the ultimate tool to complement this.

This wouldnt be that hard to do, but is it illegal to automate those submissions?

May not be illegal, but all platforms don't like it. And it's only a problem that needs solving because the internet is full of shit content.

There are N amount of job postings, but recruiters and other "middle-men" have made it so that there are N * X * Y places a candidate has to apply to.

Where X are the amount of recruiters and Y are the recruitment platforms/boards.

They literally take their clients' requirements, shuffle them around, repackage them, adding editorial fluff and then post them to Y amount of platforms. This is information warfare and we are losing the battle.

This is the net-consequence of all the "distributed" effects we've been wanting for years. Instead, there should be one database. Or at the very least an identifiable entity even if you want to repackage something. I.e. each one of these postings needs to have an agreed UID for employer, employer's job posting, recruiter, and the type of roles it applies to. We need more structure to the data, not less and more distribution across the greater internet.

That is why they don't like scrapers, because they lead to consolidation, aggregation or deduplication of data that has been needlessly duplicated in order to confuse and obfuscate.

On a side, tech-related note, this is the same reason why I hate microservices architectures: a good chunk of them distribute and duplicate pieces of data.

Re: JobFunnel, a job website search aggregator

#30

Post by sawmurai »

z3t4 wrote: post #25
sawmurai wrote: post #22

Earlier quoted context omitted.

I work for a job search site and our customers have huge problems with "mass appliers" who just apply to every job and hope that one is an actual fit.

Its not unusual that a dev job get thousands of applications. But what should the job seekers do? If you do the math the work seeker has to apply for 1000 jobs to have a statistical chance to find a match. The market doesn't work because its unbalanced. For example on a dating site where women do not reach out to men, the women will complain about the low quality, and the men has to mass message. Leading to very few…

You can already improve your statistical chance by pre-filtering jobs based on required skills etc. Say, you end up with a list of 10 out of those 1000 jobs and then apply to those. Depending on how active your job hunt is, you might even spend 15 minutes per application and tailor your CV to the job description (use the same keywords, highlight relevant experience, the regular stuff). You would already have greatly improved chances and you would not be what employers have a problem with.

Remember: If they are able to hire you without a recruiter they save a LOT of money, so they WANT you to apply directly.

Btw: The problematic mass-appliers I was refering to are the ones that apply to every damn job on the entire website. Yes, we have those. No, I don't understand their motives either. The only thing they achieve is work for the job site and the HR department, ultimately resulting in the usage of automated pre-filtering that also harms actual applicants.

Post reply on HN