Software Engineer - Data Acquisition

- Build, maintain, optimize and support large scale, cloud-native data ingestion, data storage, data processing and data serving systems. - Develop and support large production real-time systems written and maintained in Python and C++. - Understand the complex data requirements of modern AD/ADAS platforms and tailor our data ecosystem to these needs.

- 3+ years of experience with data structures/algorithms and professional software engineering in one or more programming languages (e.g., Python, Go, Java). - Development experience with autonomous driving and/or data collection using C++ under embedded environments. - 2+ years designing and building data-intensive, concurrent, scalable applications.

Our Cloud and Data Engineering organization is working on accelerating autonomous driving by providing access to petabytes of data collected from our large fleet of autonomous and non-autonomous vehicles. Efficient, fast and cost-effective access to data at large scale is key to tackle the hardest problems in AD/ADAS, from developing the Machine Learning (ML) models for perception and prediction of human driving patterns, to increasing the sophistication of our validation and simulation by identifying rare and interesting real-world driving situations. The Lakehouse ingestion platform developed by the Data Acquisition Engineering team is a fundamental building block for developing and testing modern AD/ADAS products that will impact millions of customers. The primary goal of our Lakehouse system and Fleetnik mobile app is to seamlessly ingest, enrich, and monitor fleet vehicle data as it flows into the cloud. A key goal for this role is delivering data-collection edge filtering infrastructure that supports data validation and scenario detection. Our pipelines are based on industry standard frameworks deployed to AWS. We engineer large-scale data acquisition pipelines that process hundreds of terabytes daily from numerous global ingestion sites. Our data acquisition products leverage industry-standard frameworks deployed on AWS, utilizing Java, Golang, Python, and JavaScript. We believe strongly in automation and testing to ensure delivery of robust and correct systems. We are a distributed team, working in Japan, the UK and the US. WHO ARE WE LOOKING FOR?

- Bachelor's degree in Computer Science, a related field, or equivalent practical experience. - 3+ years of experience with data structures/algorithms and professional software engineering in one or more programming languages (e.g., Python, Go, Java). - Development experience with autonomous driving and/or data collection using C++ under embedded environments.

- Experience with data platforms, data pipelines, workflow orchestration, batch processing, and/or distributed databases. - Experience writing testable, modular code in Golang or Java. - Experience working as a Site Reliability Engineer.

- Experience with cloud-based (e.g. AWS, GCP) microservice architecture, event-driven, distributed architectures. - Experience writing testable, modular code in Python. - Business-level proficiency in English speaking, reading and writing (e.g., technical documents, software documentation).

- 2+ years designing and building data-intensive, concurrent, scalable applications. - Experience with cloud-based (e.g. AWS, GCP) microservice architecture, event-driven, distributed architectures. - Experience writing testable, modular code in Python.

- Experience working as a Site Reliability Engineer. - Experience with Terraform, Docker, cloud-native technologies, networking and Kubernetes in production. - Experience designing, deploying, and maintaining multi-region and/or multi-cloud systems.