Job Description

We are seeking an experienced Cloud Data Pipeline Engineer to help design, build, and scale the infrastructure that powers advanced mobility systems. This role focuses on supporting large-scale data operations for AI/ML model development across autonomous and intelligent vehicle platforms.

As part of the Data Engineering team within the autonomy organization, you’ll play a key role in creating end-to-end pipelines that collect, process, and manage data captured from a wide array of vehicle-mounted sensors. You will work with teams focused on machine learning, perception, and system testing to ensure high-performance access to mission-critical datasets.

Key Responsibilities

• Design and maintain scalable data processing pipelines on AWS , Kubernetes , and on-prem environments.
• Process and manage structured and unstructured data collected from onboard sensors including cameras, LiDAR, RADAR, and GPS.
• Build efficient systems for ingestion, parsing, transformation, and storage of multi-terabyte sensor data per day.
• Optimize data storage, search, and compute performance using distributed architectures, caching layers, and data frameworks.
• Collaborate with cross-functional teams such as ML, QA, testing engineers, and external annotation vendors to build custom data solutions.
• Create dashboards and APIs to enable real-time monitoring and integration with ML workflows.

Required Qualifications

• Strong ability to design software architecture based on high-level technical and business needs.
• Proficient in Python or Golang for backend and data-centric development.
• Hands-on experience with PostgreSQL or other relational database systems.
• Professional experience deploying solutions on AWS cloud and Kubernetes clusters.
• Experience building multi-threaded applications, containerized backends, and RESTful microservices.

Preferred Qualifications

• Strong sense of ownership and a proactive, hands-on problem-solving mindset.
• Experience developing scalable distributed systems capable of processing terabytes of data daily.
• Background in autonomous systems or backend engineering for AI/ML data platforms.
• Familiarity with tools and technologies such as: Airflow, Terraform, Docker, REST APIs, Helm, and SQL .

positions at ASICSoft range from $50,000 - $300,000

Job Tags

Similar Jobs