Apify runs on a highly-scalable infrastructure that enables it to load and analyze millions of web pages every day. We employ a cluster of Linux servers running on Amazon EC2 and store data in MongoDB, DynamoDB, S3, Redis and SQS. The whole software stack is based on JavaScript, we're using Node.js for backend services along with Meteor and React for the frontend. Actors are running inside our custom Docker container orchestrator and web scraping tasks are performed using headless Chrome, Puppeteer, PhantomJS, Selenium or any other suitable tool. We're passionate about delivering the best service to our customers using the best technology possible, constantly improving all parts of our system. Apify is made by developers for developers. We're building a product that we ourselves use every day.
We're looking for experienced engineers who know how to design and build scalable systems and who are able to learn quickly and work independently. You will be helping us improve all parts of the Apify platform and building our current and future products. Join our team and help us make the web more programmable!
-----
Who are we looking for?
- You have experience with AWS, GCP or some other public cloud
- You have experience building backend infrastructure and know some of the technologies mentioned above
- You know the Linux ecosystem inside and out
- You are skilled at developing and debugging in JavaScript/Node.js, or have this skill in some other programming language and are willing to learn JavaScript
- Experience with Docker or other container technology is a plus
- Experience with Kubernetes is a plus
- You are able to speak and write in English
-----