BigData-Hadoop/Scala Engineer, AVP
D.B. Group5 hours ago
Pune, IndiaStaff+
Responsibilities
- Design, develop, and maintain high-performance, fault-tolerant data pipelines using modern big data technologies.
- Implement ETL data processing solutions that extract, transform, and load data from multiple sources into data platforms.
- Collaborate with data scientists, analysts, and engineers to understand requirements and deliver business-aligned solutions.
- Optimize data processing jobs for performance and cost efficiency.
- Ensure data quality, integrity, and security across data assets.
- Participate in code reviews and technical discussions, and mentor junior team members.
- Stay current with emerging technologies and best practices in the big data ecosystem.
Requirements
- Strong proficiency in Java and/or Scala for big data application development.
- Extensive experience with Apache Spark for large-scale data processing.
- Hands-on experience with Google Cloud Platform services, including Airflow, Dataproc, and BigQuery.
- Understanding of data warehousing, ETL/ELT principles, and data modeling.
- Experience with version control systems such as Git.
- Strong problem-solving, troubleshooting, communication, and collaboration skills.
- Understanding of Angular or React frameworks.
- Python, relational database experience particularly with Oracle, and Unix/Linux scripting are preferred.
- Familiarity with AWS, Azure, CI/CD pipelines, DevOps practices, data governance, and data security is preferred.
- Experience in financial services and developing user interfaces with Angular or React is preferred.
- Ability to use AI tools productively and responsibly while applying critical judgment to data and AI outputs.
Benefits
- Best-in-class leave policy and gender-neutral parental leave.
- 100% reimbursement under the gender-neutral childcare assistance benefit.
- Sponsorship for industry-relevant certifications and education.
- Employee Assistance Program for employees and family members.
- Comprehensive hospitalization insurance for employees and dependents.
- Accident and term life insurance.
- Complementary health screening for employees aged 35 and above.
- Training and development, coaching from team experts, and a culture of continuous learning.
- Flexible benefits that can be tailored to individual needs.
- Location: Pune, India.
Tech Stack
AngularApache AirflowApache HadoopApache SparkAWSAzureGitGoogle BigQueryGoogle Cloud PlatformJavaLinuxPythonReactScala
Categories
Data Engineering
About D.B. Group
D.B. Group is an Italian freight forwarder and logistics provider offering air, ocean, road, and rail transport, customs brokerage, and supply chain management for global shippers. Founded in 1980 and headquartered in Montebelluna, Veneto, it is privately held and operates through 79 subsidiaries with a worldwide partner network. The company delivers end-to-end forwarding and integrated logistics services, from consolidation and warehousing to door-to-door deliveries and trade compliance.