2 months ago
Remote, IndiaMid Level
Responsibilities
- Design, build, and maintain scalable batch and real-time data pipelines using Maxwell, Kafka, Spark, and dbt.
- Develop and optimize Bronze, Silver, and Gold data models following Medallion Architecture.
- Build and maintain cloud-native data platforms using S3, Spark, Trino, and BigQuery.
- Design data-ingestion frameworks using CDC, Maxwell, Kafka, and event-driven architectures.
- Create and maintain data warehouses, data marts, dimensional models, semantic models, and trusted datasets.
- Develop reusable dbt models, testing frameworks, documentation, automation, and CI/CD pipelines.
- Optimize Spark jobs, Trino queries, SQL queries, storage layouts, and distributed processing for performance and cost efficiency.
- Own the lifecycle of critical pipelines, including availability, monitoring, SLA adherence, observability, and incident resolution.
- Partner with Product, Engineering, Analytics, Data Science, and Business stakeholders to translate requirements into data solutions.
- Enable analytics teams through reliable datasets, lineage, governance, and Metabase dashboards.
Requirements
- At least 4 years of hands-on experience designing and building scalable data platforms, data lakes, and data warehouses.
- Strong proficiency in Spark, Scala, Python, and SQL, with experience building production-grade data pipelines and distributed processing applications.
- Experience building batch and streaming pipelines with Kafka, CDC/Maxwell, or similar event-driven technologies.
- Understanding of data lake architectures, Medallion Architecture, data modeling, partitioning, and storage optimization.
- Experience with cloud-native data platforms such as Amazon S3, BigQuery, and Trino or similar analytics engines.
- Experience designing dimensional models and star schemas and building reliable data marts for analytics and business intelligence.
- Hands-on dbt experience, including reusable models, automated testing, and documentation.
- Knowledge of data quality, observability, lineage, engineering best practices, infrastructure automation, and Git-based workflows.
- Experience optimizing large-scale pipelines, SQL queries, and distributed processing jobs for performance, scalability, and cost efficiency.
- Ability to independently own projects from design through production and collaborate effectively across Product, Engineering, Analytics, and Business teams.
Benefits
- Full-time remote work in India.
- Inclusive and diverse workplace with a remote environment.
- Competitive compensation with potential share options for certain roles.
- Regular training and an annual learning stipend.
- High autonomy, mentorship, and ambitious professional-development goals.
Tech Stack
Categories
Data Engineering
About Mrsool
Mrsool builds an on-demand delivery marketplace where customers request anything via app and independent couriers bid to fulfill orders across food, retail, and errands. The company generates revenue from delivery and service fees on its two-sided platform. Founded in 2015 and headquartered in Riyadh, it serves users across Saudi Arabia with over 10 million registered users, and is privately owned by Nomw Capital.