Live data from Hacker News

JobFunnel, a job website search aggregator

github.com

31–40 of 41 posts

Re: JobFunnel, a job website search aggregator

#31

Right now I use urlwatch[0] with custom python scripts that will extract data from the websites. Why should I switch to JobFunnel? What are the biggest selling points? [0]: https://github.com/thp/urlwatch

Most people can't do that or will gladly not do it if a service like this saves them the bother.

Re: JobFunnel, a job website search aggregator

#32

Unfortunately, a job search aggregator assumes that companies religiously post new jobs. The reality is when a company wants to hire it 'may' post a job to cover it butt in case of an EEO complaint. Mostly they have internal candidates, internally referred candidates, retained recruiters, applicants from career website who all rank above an external job site. My guess is a very low percentage of jobs actually get fil…

Conservative HR/Legal departments will often post jobs publicly to avoid a discrimination lawsuit from the EEOC.

The federal government can (and routinely does) ask mid-sized to large companies for records of their job applicants to "prove" they are not discriminating against protected categories (women, minorities, the disabled, etc).

So if the CEO/hiring exec wants to hire his good old boy friend to a position no matter what the job will still be posted and applicants will be collected even if they have no chance of being hired.

Obviously I have no data on how prevalent this practice is but I've witnessed it firsthand, so it happens.

Re: JobFunnel, a job website search aggregator

#33
post #19

Earlier quoted context omitted.

As always, consult a lawyer. But, my understanding is that you are allowed to scrape sites as long as you don't impact their ability to deliver the site to other users. In other words, don't DDoS them. Sites tried to ban scraping but last I remember seeing it was not enforceable unless it was done at high rates or maliciously. As for content, certain things like recipes aren't protected content because they are "list…

I don't think the question was: "is it legal to scrape", rather: "do they like to be scraped". If they wanted to, I'm sure they could make scraping harder (more annoying). Which, I suppose, thus comes down to: is being aggregated a net plus or minus for their business. Probably "it depends" on what the aggregator does with the data. So, just to get this pun in: it then comes down to: is being aggregated a net plus or…

Then no, very few for profit companies like to be scraped.

It would be easier for them to provide an RSS feed or a free API if they wanted to share their data.

Re: JobFunnel, a job website search aggregator

#35
post #9

This is essentially what large job sites like Indeed do themselves, but they have entire teams maintaining the scraping pipeline. I've worked for one of their competitors.

One pet peeve I have with sites like indeed is all of the subterfuge that goes on. For instance, the half-assed sort by date feature. Indeed adds in month old sponsored postings with new postings, and often repeats those old postings on consecutive pages. Many sites also shamelessly reset their posting dates so that nothing is ever more than a week old. Stripping away the middleman's ability to manipulate the present…

One thing a multi-site scraping aggregator could do would be detect listings that have been re-posted with just a date change, and show the real amount of time the ad has been up, alongside how long it's been most recently refreshed.

It would be interesting to search for ads that were posted a long time ago and are still unfilled.

And it would be intersting to see how that add "posted 12 hours ago" is the same one that was posted 6 months ago and is currently being posted by 5 different recruiters with almost identical wording apart from their boilerplate.

And it would also be interesting to see the different salaries/ranges that are mentioned on different copies of the same ad. I've noticed different recruiters sometimes post the same ad, but with a different salary ceiling. Guess which number I'd like to have when negotiating... And if I see a job whose salary has been creeping up for a few months, that's an interesting trend too.

Re: JobFunnel, a job website search aggregator

#36
post #26

Earlier quoted context omitted.

When I look at your signup form I can't really find my profession. I had this problem for a while now but maybe I should simply ask: I do industrial software engineering (in my case in automotive) that targets a mixture of embedded, desktop and server environments. This is done mostly in C/C++ with some Python, Shell and maybe Rust. What is the proper profession name for me? Is this a full stack engineer? Not likely…

I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.

I just took a look. Nice looking site, by the way :-)

I have the same issue at signup as the GP - I find myself rather unsure what categories make sense for me on your signup page.

Similar to the GP, a mixture of embedded, servers, and webdev, except I wouldn't say I do just industrial. Feel free to look at my LinkedIn profile (the link is in my HN profile) if you think it could give you some ideas for additional categories on your signup page.

Re: JobFunnel, a job website search aggregator

#37
post #36

Earlier quoted context omitted.

I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.

I just took a look. Nice looking site, by the way :-) I have the same issue at signup as the GP - I find myself rather unsure what categories make sense for me on your signup page. Similar to the GP, a mixture of embedded, servers, and webdev, except I wouldn't say I do just industrial. Feel free to look at my LinkedIn profile (the link is in my HN profile) if you think it could give you some ideas for additional cat…

Based on your skills, I would suggest choosing the Javascript and System/Devops categories.

Re: JobFunnel, a job website search aggregator

#38
post #29

Earlier quoted context omitted.

This wouldnt be that hard to do, but is it illegal to automate those submissions?

May not be illegal, but all platforms don't like it. And it's only a problem that needs solving because the internet is full of shit content. There are N amount of job postings, but recruiters and other "middle-men" have made it so that there are N * X * Y places a candidate has to apply to. Where X are the amount of recruiters and Y are the recruitment platforms/boards. They literally take their clients' requirement…

I think it would be messy, but doable, to build a one application platform that is tailored to individual websites behind the scenes. It knows how to input the information, checks the boxes, and then collates the responses and makes applications easy to track. Actually kind of curious why this doesnt exist

Re: JobFunnel, a job website search aggregator

#39
post #26

Earlier quoted context omitted.

When I look at your signup form I can't really find my profession. I had this problem for a while now but maybe I should simply ask: I do industrial software engineering (in my case in automotive) that targets a mixture of embedded, desktop and server environments. This is done mostly in C/C++ with some Python, Shell and maybe Rust. What is the proper profession name for me? Is this a full stack engineer? Not likely…

I agree and I'm not sure either. Maybe if you are interested I can modify your category in the backend and set it to a custom one and start sending your C/C++/Embedded development remote jobs.

It's fine, I'm not actively looking right now (I really like the website and your manual approach though).

I'm just wondering wether non-web dev jobs don't exist anymore or are just out of fashion/not mentioned that often

Post reply on HN