Ask HN: Most difficult programming challenge you solved in 2014?

#1

Post by haidrali » Fri, Dec 19, 2014, 11:32 PM UTC

What is your most difficult programming or software engineering challenge you done in 2014? Be it any Algorithm, Project Deadline or anything related to Software. Mine is setting up Apache Nutch along with Apache Solr and Hbase for large crawling project.

Thanks

Re: Ask HN: Most difficult programming challenge you solved in 2014?

#2

Post by gvickers » Sat, Dec 20, 2014, 12:02 AM UTC

The most difficult project I have solved (just finishing up the implementation) is developing a monitoring solution for a bunch of legacy telephone PBX's.

Essentially, the bureaucratic overhead for getting a bunch of companies to open their firewalls to us was unfeasible. Long story short, I ended up hijacking the SSL/VPN generated by a running JVM to forward a bunch of SNMP/OSSI-polling traffic to our api.

At the end, after implementing the above, I found out about a service port for outgoing only traffic offered to business partners. That was much easier to use, only requiring nginx to split off a certain sub-path of SSL traffic + business partner status.

I am still proud of the original hack, although brittle and ugly it was very exciting to get working.

Re: Ask HN: Most difficult programming challenge you solved in 2014?

#3

Post by gesman » Sat, Dec 20, 2014, 3:26 AM UTC

Correlate real time online banking traffic (5,000,000 hits a day) with multiple threat intelligence feeds fraud data to deliver real time security alerts within 10 seconds of suspicious online activity.

Re: Ask HN: Most difficult programming challenge you solved in 2014?

#4

Post by fiscalnonsense » Sat, Dec 20, 2014, 9:42 AM UTC

Of everything done, doing nothing about something "so that I can be home at night" still places highest in my list of challenges with software engineering.

Re: Ask HN: Most difficult programming challenge you solved in 2014?

#5

Post by lomnop » Sat, Dec 20, 2014, 11:12 AM UTC

I wrote a automation script which keep track of server process and recover them on failure

Re: Ask HN: Most difficult programming challenge you solved in 2014?

#6

Post by pizza » Sun, Dec 21, 2014, 4:46 AM UTC

gesman wrote: post #3

Correlate real time online banking traffic (5,000,000 hits a day) with multiple threat intelligence feeds fraud data to deliver real time security alerts within 10 seconds of suspicious online activity.

What's the next step after a security alert is delivered (i.e. does it go to a person first? does it get written down somewhere? are these bells constantly ringing?)? I promise I'm not a bad guy :)

Re: Ask HN: Most difficult programming challenge you solved in 2014?

#7

Post by gesman » Mon, Dec 29, 2014, 1:03 AM UTC

pizza wrote: post #6

gesman wrote: post #3

Correlate real time online banking traffic (5,000,000 hits a day) with multiple threat intelligence feeds fraud data to deliver real time security alerts within 10 seconds of suspicious online activity.

What's the next step after a security alert is delivered (i.e. does it go to a person first? does it get written down somewhere? are these bells constantly ringing?)? I promise I'm not a bad guy :)

The special care is taken to avoid alert blindness (i.e. too many similar alerts inevitably cause ignorance syndrome). I made a human study to make sure the timing of alert is enough to keep centinel's attention sharp, yet no important information event is missed.

The big picture - the action is taken to protect possibly compromised client's bank account.