4 months ago
United Arab Emirates (city not specified)Senior
Responsibilities
- Build pipelines that ingest multi-camera video, IMU, LiDAR, and GPS data from vehicles into cloud storage.
- Synchronize and geo-reference multi-sensor data streams.
- Own sensor-data storage layout, partitioning, lifecycle management, archival tiers, and cost control.
- Build validation and monitoring for incomplete uploads, missing or unsynchronized streams, and unusable vehicle data.
- Prepare, version, and deliver location- and route-based training datasets for autonomous-driving models.
- Develop imagery, GPS-track, and geodata pipelines, including ingestion, conflation, validation, and publication.
- Maintain fast spatial queries across large PostGIS and GeoParquet tables and work with company data in BigQuery.
Requirements
- 4+ years of data engineering experience.
- Experience working with vehicle or robot multi-sensor data, including cameras, IMU, or LiDAR, and synchronizing sensor streams.
- Experience preparing training datasets for computer vision or autonomous-driving models.
- Experience handling large volumes of binary or media data in S3 or GCS and using Spark or equivalent distributed processing.
- Hands-on experience with spatial data, including PostGIS, GeoPandas/Shapely, coordinate reference systems, and GPS tracks.
- Strong Python and SQL skills.
- Experience with AWS or GCP, Docker, and Kubernetes.
- Nice-to-have experience with ROS2 bag, MCAP, point clouds, Parquet, Delta, Iceberg, Databricks, Argo Workflows, Airflow, OpenStreetMap, Overture Map, QGIS, or BigQuery.
Benefits
- Access to mentoring, career consulting, and learning programs.
- Global Talent Exchange Program for international experience.
- Company-wide challenges, awards, sports activities, social-impact initiatives, and volunteering projects.
- Language courses and internal speaking clubs with co-financing.
- Benefits may vary depending on location.
Tech Stack
Apache AirflowApache SparkAWSDatabricksDockerGoogle BigQueryGoogle Cloud PlatformKubernetesPythonSQL
Categories
Data Engineering
About inDrive
inDrive builds a global mobility and urban services marketplace best known for ride-hailing, with additional offerings in intercity rides, delivery, and financial services. The privately held company is headquartered in Mountain View, California, and operates across 48 countries, monetizing through fees on transactions in its app. Its platform emphasizes driver–rider price negotiation and has amassed hundreds of millions of downloads.