Would love to have a dump of the data: Every time people scrape these data, they have to clean it again and again.
Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
11–20 of 257 posts
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#12Hello everyone. I quickly built this little tool based on public records provided by the government. The amount of information they provide is incredible. There are no explicit names, but for small startup or exec position it is easy to guess who is who. As far as I know this is the biggest LCA database so far.
Can I find the highest salaries?
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#13What's being used on the front-end to display the tables and pages and the back-end to store all the info?
Time required to create?
Other fun details?
(I ask because I have another dataset I want to work on recreating online in a searchable manner)
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#14What's being used on the front-end to display the tables and pages and the back-end to store all the info? Time required to create? Other fun details? (I ask because I have another dataset I want to work on recreating online in a searchable manner)
Front End: twitter bootstrap. Back End: RoR+postgreSQL
I roughly spent a week on it. At first I was cleaning and moving some data around with RoR but it didn't seemed right to me. Then I started poking around with postgreSQL and once you get a hold of it, it's super powerful and does most of the job. Use indexes... on fairly large datasets it really makes a difference.
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#15Very cool site! I found similar data a while back, but nowhere near this organized/pretty to look at. It helped me make the decision of NOT taking a job that I had a hunch was a lowball offer.
Does anyone know if companies are allowed to include the bonus $ in the 'salary' figure in these LCAs?
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#16Hello everyone. I quickly built this little tool based on public records provided by the government. The amount of information they provide is incredible. There are no explicit names, but for small startup or exec position it is easy to guess who is who. As far as I know this is the biggest LCA database so far.
Great implementation. I've seen the raw data before but never had the web development skills to execute on this idea. Can you also add a query where once you select a company and year, it groups by title and gives average salary.
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#17Earlier quoted context omitted.
Thanks this is way better than existing sites. I did notice that searching for Google gives you 5 different entities that are all Google.
Yes I am still cleaning the data. It's all unbelievable the amount of crap you can find in the public records. I have a lot of duplicates unfortunately. Down the road, I'm planning on providing a couple of cool charts/map about trends and evolutions.
A few things I'd be interested in:
- ratio of LCAs to total permanent full time employees. This will show which companies are really leaning on the H1-B visa (I'd estimate my "household name" software company is at about 50%)
- Source of prevailing wage. Interestingly employers don't have to use the BOL published data and can self report. I'd be interested to see how many self report.
- The average delta between prevailing wage and salary per employer/job title.
- A way to search by geographic region.
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#18Earlier quoted context omitted.
Thanks this is way better than existing sites. I did notice that searching for Google gives you 5 different entities that are all Google.
Yes I am still cleaning the data. It's all unbelievable the amount of crap you can find in the public records. I have a lot of duplicates unfortunately. Down the road, I'm planning on providing a couple of cool charts/map about trends and evolutions.
[deleted]
Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#19Re: Show HN: Visa Explorer – Salaries, lawyers, companies of all H-1B in the USA
#20Weird seeing yourself listed on a site like this! I imagine my co-workers could find me if they were so motivated.
(this isn't a criticism of the site - just an interesting side effect of this kind of data transparency)