HERE is seeking experienced senior and mid-level scaling engineers to join the Capture Systems team, who design and maintain data collection systems.
Our scaling engineers compose the cloud services, data-stores and ingestion points that track and monitor HERE's global collection fleet. Metadata detailing our collection efforts continuously streams into this system from around the world. The advent of autonomous vehicles presents a huge shift in the scale of data HERE will bring online in the coming years. We want to scale our services before this huge shift.
Your daily work will include tasks such as: -Extend distributed compute systems to scale real-time analytics, ETL and message multiplexing; -Maintain and build out a cohesive system of data-stores, with a range of use cases; -Test, profile and instrument through-put and capacity of team services; and -Honor and negotiate interface contracts between team services and users.
Requirements -Python expertise; -Experience with multiple parallel and distributed programming techniques, including: --when crossing machine boundaries; --when solving IO and compute bound problems; -Experience with a range of data-stores (Postgres, Neo4j, Kafka, Elasticsearch, S3, HDFS etc) -Experience dealing with stream processing systems (Storm, Flink, etc); -Worked with a team that has scaled past the limits of a monolithic data-store; -Worked with a team that has scaled from millions of events per week to x100-1000 that volume.
Pluses -Experience with JVM-based languages; -Experience with devOps tools such as Ansible, Chef, Puppet; -Linux OS expertise.
What is HERE? HERE collects, processes and serves out mapping data and services that cover the globe. We are independently operated, and owned by a consortium including BMW, Audi and Daimler.
Does this sound like something you are up for? Email me at thomas.watson@here.com