Live data from Hacker News

Ask HN: What did you work on in 2017?

news.ycombinator.com

571–580 of 583 posts

Re: Ask HN: What did you work on in 2017?

#571

I quit my job as a software engineer at Google early this year to teach people how to code. I started paying people $15/hr to learn so they can make ends meet while learning instead of working at Walmart. I thought about all the missing pieces in my engineering growth and created a curriculum that welcomes students from 0 engineering background and plugs in all the holes that were black boxed to me in my engineering…

Its just like Udacity.

Re: Ask HN: What did you work on in 2017?

#572

Lambda School - a rigorous, live online computer science education that’s free until you’re hired. https://LambdaSchool.com/computer-science Started as a side project in January, and I had no idea it would take off like this. We now have 20 employees, including instructors from Google, Apple, Blizzard, etc. and our first graduating students are getting hired for great salaries all over the US. (Average is $85,000 in…

Do you accept international applicants and are the classes online or a traditional classroom setup?

Re: Ask HN: What did you work on in 2017?

#573

I worked on https://www.pagedash.com , bookmarking with the content if you will. I also launched https://themalaysianpulse.com , a Malaysian news aggregator.

> I also launched https://themalaysianpulse.com , a Malaysian news aggregator. Wonderful work! Any chance you could talk more about how you built this website? For example, where do you get your news from, how do you aggregate it, and which technology stack do you use on the server side?

Thanks :) Yup, I source news from local news portals as shown in the website. Hourly, each source is crawled in each relevant category to get the latest news items, and stored into a database. Another job then goes and fetches the body of all these articles. (I use https://github.com/robfig/cron for cron jobs). Server and HTML templates are both Golang. As for the aggregation (grouping) algorithm, I'll just say that it's straight out of the textbook http://infolab.stanford.edu/~ullman/mmds/ch3.pdf

Re: Ask HN: What did you work on in 2017?

#574

Earlier quoted context omitted.

> I also launched https://themalaysianpulse.com , a Malaysian news aggregator. Wonderful work! Any chance you could talk more about how you built this website? For example, where do you get your news from, how do you aggregate it, and which technology stack do you use on the server side?

Thanks :) Yup, I source news from local news portals as shown in the website. Hourly, each source is crawled in each relevant category to get the latest news items, and stored into a database. Another job then goes and fetches the body of all these articles. (I use https://github.com/robfig/cron for cron jobs). Server and HTML templates are both Golang. As for the aggregation (grouping) algorithm, I'll just say that…

Thanks for the detailed reply. :-)

> As for the aggregation (grouping) algorithm, I'll just say that it's straight out of the textbook http://infolab.stanford.edu/~ullman/mmds/ch3.pdf

So, in other words, you're using the MinHash algorithm as well as Locality-sensitive hashing (LSH)? How much volume are you able to process in how much time?

By the way, I first learned about this topic through Stanford’s “Mining of Massive Datasets” (MMDS) course that used to be free on Coursera. So it's thrilling to see someone put it to use in the real world and talk about it, too! :-)

Re: Ask HN: What did you work on in 2017?

#575

Hosted Comments https://www.hostedcomments.com/ , a Disqus alternative with a focus on privacy. The learning experience of building Hosted Comments was great : using iframes to embed comments in websites, building a commenting system with voting and some features which Disqus does not have : locking comments, hiding comments (not yet deployed https://imgur.com/a/R89Cw ). It started out as a sideproject, then decided…

Suggestion: Put registration forms in the main page. Put simple captcha. Remove whatever barriers to encourage registration

Re: Ask HN: What did you work on in 2017?

#576

Earlier quoted context omitted.

Thanks :) Yup, I source news from local news portals as shown in the website. Hourly, each source is crawled in each relevant category to get the latest news items, and stored into a database. Another job then goes and fetches the body of all these articles. (I use https://github.com/robfig/cron for cron jobs). Server and HTML templates are both Golang. As for the aggregation (grouping) algorithm, I'll just say that…

Thanks for the detailed reply. :-) > As for the aggregation (grouping) algorithm, I'll just say that it's straight out of the textbook http://infolab.stanford.edu/~ullman/mmds/ch3.pdf So, in other words, you're using the MinHash algorithm as well as Locality-sensitive hashing (LSH)? How much volume are you able to process in how much time? By the way, I first learned about this topic through Stanford’s “Mining of Mas…

Yup, MinHash with LSH. It's quite fast and low compute intensive, because articles shown are limited by recency (e.g. past 24 hours), say order of hundreds and thousands in a few seconds. Someone wrote an open source LSH on github on Golang, so no credits to me :) Probably would not have been able to code LSH myself.

Re: Ask HN: What did you work on in 2017?

#577

Earlier quoted context omitted.

Thanks for the detailed reply. :-) > As for the aggregation (grouping) algorithm, I'll just say that it's straight out of the textbook http://infolab.stanford.edu/~ullman/mmds/ch3.pdf So, in other words, you're using the MinHash algorithm as well as Locality-sensitive hashing (LSH)? How much volume are you able to process in how much time? By the way, I first learned about this topic through Stanford’s “Mining of Mas…

Yup, MinHash with LSH. It's quite fast and low compute intensive, because articles shown are limited by recency (e.g. past 24 hours), say order of hundreds and thousands in a few seconds. Someone wrote an open source LSH on github on Golang, so no credits to me :) Probably would not have been able to code LSH myself.

It would be awesome if you blogged about your entire experience setting up your news aggregator. But I guess your first priority is PageDash these days so I can keep dreaming. :-)

Re: Ask HN: What did you work on in 2017?

#578
post #281

Earlier quoted context omitted.

Wow, is it even legal in your country? What was the official reason mentioned? Maybe you can sue them?

In the US this would be 100% legal. For almost all jobs, you can fire someone for any reason (I don't like your shirt, your jokes weren't funny, it's a Tuesday) or literally no reason at all. The exceptions are few and far between - unions provide additional protection via collective bargaining agreements; you can't fire someone for being in a protected class (i.e. because of their race or gender); and you can't fire…

While it is true that most employment is “at-will” (which means that both sides voluntarily choose to employ/be employed) for both sides, in a friendly employee state like California, there are numerous wage claims and employment law suits that come with doing business. It’s not as easy to fire in some states.

Re: Ask HN: What did you work on in 2017?

#579

I quit what many would consider a successfull job in programming and had a sabbatical year. Moved to a smaller town and down sized everything in spending to the point where I pay $600 per month for housing, food and bills, so living of my savings haven't been an issue at all. I have focused on things like reading (read +40 books in 2017, up from 1-2 per year), wood working, sketching, running and skiing. To keep up m…

Hi I've also recently (re)discovered reading books. What books do you recommend?

I use GoodReads a lot for discovery. See what friends are reading and browse lists that people make (https://www.goodreads.com/list)

Re: Ask HN: What did you work on in 2017?

#580

At the end of 2016 I left contracting gig for a full time position to work on helping solve intermittency problem with solar PV power generation through forecasting. With a team of 3 including myself, the only professional software developer, we have launched and run a solar radiation and PV power forecasting/observation API (solcast.com.au) that can provide solar radiation and PV power forecasts world wide that upda…

That's really cool. I'd love to work on something like this.
Post reply on HN