BigData-Hadoop/Scala Engineer, AVP
D.B. Group2 months ago
Pune, IndiaSenior
Responsibilities
- Design, develop, and maintain high-performance, fault-tolerant data pipelines using modern big data technologies.
- Implement ETL data-processing solutions from varied sources into data platforms.
- Collaborate with data scientists, analysts, and engineers to deliver business-focused data solutions.
- Optimize data-processing jobs for performance and cost efficiency.
- Ensure data quality, integrity, and security across data assets.
- Participate in code reviews and technical discussions.
- Mentor and coach junior or less experienced engineers.
- Stay current with emerging big data technologies and best practices.
Requirements
- Strong proficiency in Java and/or Scala for big data application development.
- Extensive experience with Apache Spark for large-scale data processing.
- Hands-on experience with Google Cloud Platform, including Airflow, Dataproc, and BigQuery.
- Understanding of data warehousing, ETL/ELT principles, and data modeling.
- Experience with version control systems such as Git.
- Strong problem-solving, troubleshooting, communication, and collaboration skills.
- Understanding of Angular or React frameworks.
- Python proficiency for data manipulation, scripting, or data-science tasks is preferred.
- Experience with relational databases, particularly Oracle, is preferred.
- Unix/Linux scripting experience for automation and system administration is preferred.
- Familiarity with AWS or Azure is a plus.
- Knowledge of CI/CD pipelines, DevOps practices, data governance, and data security is preferred.
- Financial-services industry experience and Angular/React UI development experience are preferred.
- Ability to use AI tools productively while applying responsible and ethical judgment to data and AI outputs is preferred.
Benefits
- Best-in-class leave policy.
- Gender-neutral parental leave.
- 100% reimbursement under the childcare assistance benefit.
- Sponsorship for industry-relevant certifications and education.
- Employee Assistance Program for employees and their family members.
- Comprehensive hospitalization insurance for employees and dependents.
- Accident and term life insurance.
- Complementary health screening for employees aged 35 and above.
- Training and development opportunities.
- Coaching and support from team experts.
- Flexible benefits that can be tailored to individual needs.
Tech Stack
AngularApache AirflowApache HadoopApache SparkAWSAzureGitGoogle BigQueryGoogle Cloud PlatformJavaLinuxPythonReactScala
Categories
Data Engineering
About D.B. Group
D.B. Group is an Italian freight forwarder and logistics provider offering air, ocean, road, and rail transport, customs brokerage, and supply chain management for global shippers. Founded in 1980 and headquartered in Montebelluna, Veneto, it is privately held and operates through 79 subsidiaries with a worldwide partner network. The company delivers end-to-end forwarding and integrated logistics services, from consolidation and warehousing to door-to-door deliveries and trade compliance.