Ask HN: Who is hiring? (May 2014)

Academia.edu is an agile startup located in San Francisco on Kearny and Bush Street. Our CEO is Richard Price who received his PhD from Oxford in Philosophy and is an avid sailor. Our team is also led by CTO Ben Lund who is not only a great technical leader, but also an amazing foosball player.

We are well-funded by Khosla Ventures and we are on a mission to Open Science. Our goal as a company is to build an end-to-end publication system that provides the world with free and accessible academic and scientific papers. So far we have 9,364,002 users.

Feel free to check out the technical projects that our engineers are tackling (see below) or visit our hiring page at https://www.academia.edu/hiring to learn more about us. We look forward to hearing from you.

We are Hiring a Team to Build a Better Future

Here at Academia.edu you will have an opportunity to join an agile team of 9 Engineers who are all making a positive impact on the world by contributing to a movement called Open Science. As a member of our team you will be given a lot of autonomy to choose projects that interest you the most and the ability to make product decisions with our CTO Ben Lund and CEO Richard Price.

We are currently tackling five incredibly difficult product challenges. Some of these projects have been attempted by larger companies and have failed. In order to be successful we will need to think way outside-of-the-box and take a leap into the unknown…

Peer Review

We want to build a peer review platform that allows layers of discussion on top of a single document. One of the biggest challenges we face is that contextual commenting at a large scale has yet to be achieved. In order to be successful we need to find original and novel solutions because simple approaches like putting a blog-style comment box at the end of the paper has been tried before and has not been effective.

To build Peer Review we must figure out a way to transform all the wide array of styles from any given PDF paper to a clean and consistent format that is embedded for a suitable commenting UI. We are experimenting to build a rich inline-commenting and discussion interface as well as a reputation system that surfaces quality comments.

Interface Design

We currently have 7.5 million users who upload their research papers. Academia converts these PDFs to HTLM5 to display in the browser. We face the challenges of building web UIs for scientific content such as 3D molecular visualizations and tools for exploring genetic sequences. We will also build back-end parsers, converters, and storage schemes to enable these UIs.

Recommendation Engine

We have a news feed that displays recommended papers to our users. Currently we use a simple rule-based system where papers are tagged by research interests and our users can follow those research interests. In addition, our users can follow each other. We want our users to feel as if they are attending an amazing conference where everything we show them is the most relevant and up-to-date information that is available in their field.

In order to improve our recommendation engine, we will be immersed in Natural Language Processing and Machine Learning. We want to identify which particular field of the paper it correlates to (math, biochemistry, anthropology, etc.) and the type of document (original research, a review article, a conference presentation, a lecture note or some other content). Using everything from a paper’s previous viewers on Academia.edu to its author and content to its place in the citation graph, we want to determine the relevance of a particular document to a particular user. Lastly, using large-scale data analysis we want to identify trending papers, highlight influential researchers and help the public uncover important new work more quickly and reliably.

Mobile App

Academia does not have a mobile app but we are dedicated to building one!

Working with a clean slate, we will design and build a mobile API that displays Academia’s core features. These features will include the user profile, upload papers, news feed, analytic data, and the ability to make comments on papers (Peer Review). In order to build a dynamic mobile API, we will write easy-to-use client libraries in a wide range of scripting languages that will encourage integration with Academia’s data, content and identity into their apps.

Speed, Scale, & Storage

Our engineering team will have to build highly scalable systems that effectively store and analyze our entire stream of hits. We have built an analytics dashboard so that every user can see how many people viewed their profile and how many people have read their uploaded papers. We enabled this feature by storing structured data in DynamoDB- currently 343 million rows and growing 10% per month. We want to build features that require more sophisticated aggregations on this data than DynamoDB can provide.

Furthermore we will need to figure out how to effectively store massive amounts of data while increasing the speed of our product especially to parts of the world where there is slower internet connections. This is important because areas in the world with slower connections tend to be where researchers can benefit the most from open access to research. Our platform must be useable for them too.

Future at Academia.edu

We have a fun and agile team and we are growing (our site usage grows 10% per month)! We have the resources to make our mission come true. We just raised $11 million from Khosla Ventures, Spark Capital, and True Ventures.

Apply

If you think you would be interested in solving some of these technical problems, then please do not hesitate to contact ashley@academia.edu. Or if you are interested in chatting with our CEO Richard or meeting the team for a game of foosball, then let us know as you are more than welcome to drop by our office in Downtown San Francisco.

Los Angeles

VISA, FULL TIME

SCOPELY (www.scopely.com)

Title: Lead/Sr. Data Wizard/Engineer/Master/Munger

Cloud hosting, external API consumption, data ingestion and batch processing services like Hadoop are your focus if this is the right position for you.

What will you do?

Build an A/B testing service to help project revenue outcomes of potential games

Automate the import of data from a variety of sources (ad providers, for example) into a singular data source. (Technical: RESTful API, AWS, Command Line Code)

Aggregate, normalize and process data and work with Product Managers in an effort to gain perspective on user behavior and monetization strategy. (Technical: Python, RedShift, MySQL, Hadoop)

Produce automated high-level reports, dashboards and visualizations for many teams at Scopely including Revenue Operations and Product Management. (Technical: Pandas/Python ---> Tableau, d3)

Create the infrastructure to drive an ad-mediation service for determining optimal ad-selection for certain users via application of intelligent algorithms (Technical: Green field)

What do you need?

Batch processing service experience via Hadoop or similar proprietary variants (Voldermort, etc.)

Python or Perl or Shell Scripting programming experience (OO)

SQL Mastery. Inner and outer joins, windowing functions, you should know it all.

Experience with third-party API integration.

AWS or similar experience. Big plusses for S3/Redshift experience.

Experience in large throughput environments.

Stats, for perspective: Daily data ingestion rate: ~100 GB per day SQS: approx. 35 million messages per day Number of rows in the largest table > 4 Billion Size of the largest table = ~ 1TB Total row count in our Data Warehouse > 35 Billion Total size of our data warehouse > 9TB 1.2B API requests per week - all generating analytics events.

Austin, Blacksburg, San Antonio or San Francisco!

    _________
   |\       /|
   | \     / |
   |  `...'  |
   |__/___\__|

* Mailgun is The Email Service for Developers.

* We make it easy for developers to implement email into their software.

* We're ex-YC and were acquired by Rackspace in 2012 but remain an independent product.

* We move fast in a startup-like atmosphere but we have access to juicy hardware, large marketing muscle and world class data centers.

+++ Scalability Engineer +++

* Working on Mailgun sending pipeline.

* Scaling and tuning Cassandra clusters.

* Optimizing existing and writing new Python and Go code.

* Benchmarking and load testing.

* Improving Mailgun resilience and fault tolerance with better algorithms.

+++ Infrastructure Engineer +++

* Working on Mailgun infrastructure including inter-process communication, fail over, monitoring and auto recovery.

* Optimizing Mailgun deployment, continuous integration and service discovery.

+++ Spam Fighting Engineer +++

Finding spammers and fraudsters with smart algorithms.

+++ Deliverability Engineer +++

Automating email deliverability best practices into code. You know email and you prefer commanding an army of bots instead of humans.

+++ Read more here +++

https://github.com/mailgun/hiring

To apply just shoot us an email: hack@mailgun.net