1 month ago
Pune, IndiaSenior
Responsibilities
- Design and automate distributed systems for ingesting and transforming relational, event-based, and unstructured data.
- Build, operate, monitor, troubleshoot, and optimize reliable, scalable data pipelines and ETL/ELT processes.
- Design physical data models, database structures, indexing strategies, and table relationships for performance and scalability.
- Develop and operate large-scale cloud-based and distributed data storage and processing solutions.
- Implement data-quality, data-integrity, data-governance, metadata, retention, and access-management processes.
- Automate repetitive data preparation, integration, and data management activities to reduce manual effort and errors.
- Support analytics, data science, machine learning, reporting, and other data-driven applications.
- Provide ongoing support and performance optimization for developed data pipelines.
- Collaborate with business stakeholders, IT experts, subject-matter experts, and product teams to deliver data solutions.
- Coach and develop less experienced team members and contribute to continuous improvement, cost optimization, and scalability initiatives.
Requirements
- College, university, or equivalent degree in a relevant technical discipline, or relevant equivalent experience.
- 5 to 8 years of experience in data engineering.
- Experience building and optimizing scalable data pipelines, ETL/ELT processes, and data integration solutions.
- Proficiency in Python, SQL, and Spark, with PySpark preferred.
- Experience processing and managing large data sets and designing Big Data platforms with open-source and third-party tools.
- Experience with clustered compute and cloud-based implementations, large file movement, and data extraction from varied sources.
- Experience integrating with platforms such as Palantir, Snowflake, and Neo4j.
- Knowledge of machine learning workflows, model deployment, advanced analytics, and AI/ML concepts and tools.
- Understanding of data governance, data cataloging, metadata management, and tools such as Azure Purview and Alation.
- Experience with graph data modeling and graph databases such as Neo4j or TigerGraph is preferred.
- Familiarity with data regulations, complex business systems, IoT technology, Agile software development, and continuous improvement is preferred.
- Experience enabling self-service data engineering pipelines and using Copilot or AI capabilities to improve pipeline development and testing is preferred.
- Strong communication, ownership, proactive problem-solving, and stakeholder collaboration skills are required.
- Knowledge of technologies including Spark, Scala or Java, MapReduce, Hive, HBase, and Kafka is preferred.
Benefits
- Work from the Cummins Pune IOC-B office three days per week.
- Work schedule includes several hours of overlap with the US Eastern Time zone.
- Cummins is an equal opportunity employer.
Tech Stack
Amazon DynamoDBApache CassandraApache HadoopApache HBaseApache HiveApache KafkaApache SparkJavaMongoDBNeo4jPythonScalaSnowflakeSQL
Categories
Data Engineering
About Cummins
Cummins Inc. designs and manufactures diesel, natural gas, and electrified powertrains, generators, and related components (turbochargers, filtration, emission systems) for commercial vehicles, industrial equipment, marine, rail, and power markets. It sells to OEMs and fleet operators and provides parts and service through a global distribution network. Founded in 1919 and headquartered in Columbus, Indiana, Cummins is a public company listed on the NYSE (CMI).