ETL / Big Data Developer (Hadoop, Scala)– Home Loan Savings, VP
D.B. Group16 hours ago
Pune, IndiaSenior / Staff+
Responsibilities
- Design, develop, and optimize scalable ETL processes for ingesting, transforming, and loading large datasets.
- Translate business and data requirements into technical specifications and data models with analysts and architects.
- Develop data pipelines and complex transformations using Scala, Spark, and Hadoop ecosystem technologies.
- Write tested Scala code for data processing applications, Spark jobs, and utilities using functional programming principles.
- Use ServiceNow to manage incidents, problems, requests, and changes in accordance with ITIL processes.
- Monitor and troubleshoot big data jobs and infrastructure.
- Implement data quality checks and validation rules while following data governance, security, and regulatory requirements.
- Collaborate with global cross-functional teams and communicate technical concepts to technical and non-technical stakeholders.
Requirements
- 5–8 years of hands-on experience in data engineering, ETL development, or big data roles.
- Expert-level Scala programming experience for data processing.
- Extensive hands-on experience with Hadoop ecosystem technologies, including HDFS, Spark, Spark SQL, Spark Streaming, and Hive.
- Experience designing and implementing complex ETL processes for large-scale data environments.
- Proficiency with ServiceNow for incident, problem, and change management.
- Proficiency in SQL for data manipulation and analysis.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
- Preferred experience with Python, Google Cloud Dataproc, NoSQL databases such as HBase, Cassandra, or MongoDB, and data governance frameworks and tools.
- Financial services experience, particularly in regulatory reporting or risk data, is desirable.
Benefits
- Flexible benefits scheme with best-in-class leave policy.
- Gender-neutral parental leave and childcare assistance with 100% reimbursement.
- Sponsorship for industry-relevant certifications and education.
- Employee Assistance Program for employees and family members.
- Comprehensive hospitalization insurance for employees and dependents.
- Accident and term life insurance.
- Complimentary health screening for employees aged 35 and above.
- Training, development, coaching, and continuous learning support.
- Location: Pune, India.
Tech Stack
Apache CassandraApache HadoopApache HBaseApache HiveApache KafkaApache SparkGoogle CloudMongoDBPythonScalaSQL
Categories
Data Engineering
About D.B. Group
D.B. Group is an Italian freight forwarder and logistics provider offering air, ocean, road, and rail transport, customs brokerage, and supply chain management for global shippers. Founded in 1980 and headquartered in Montebelluna, Veneto, it is privately held and operates through 79 subsidiaries with a worldwide partner network. The company delivers end-to-end forwarding and integrated logistics services, from consolidation and warehousing to door-to-door deliveries and trade compliance.