Lead Engineer, Data Ingestion, VP
D.B. Group15 hours ago
Pune, IndiaStaff+
Responsibilities
- Provide hands-on technical leadership for scalable, secure, and resilient data-ingestion platforms.
- Define technical direction, architecture, engineering standards, and reusable development patterns.
- Lead development using Java, Spring Boot, Apache Spark, PySpark, Kubernetes, OpenShift, and Google Cloud services.
- Build reusable frameworks and components for batch, API-based, event-driven, and distributed data processing.
- Remain involved in coding, prototyping, code reviews, troubleshooting, performance engineering, and critical technical changes.
- Own production readiness, observability, service-level objectives, capacity, resilience, incident resolution, and remediation.
- Embed information security, data management, risk, audit, and regulatory controls throughout the engineering lifecycle.
- Influence cross-team architecture decisions, reduce duplication and technical debt, and improve operational risk.
- Mentor and coach engineers while fostering accountability, collaboration, and continuous learning.
Requirements
- Significant software or data engineering experience, including technical leadership of complex platforms or products in a large organization.
- Strong hands-on experience with Java, Spring Boot, and Apache Spark using Java and/or PySpark.
- Strong understanding of distributed processing, SQL, data modeling, APIs, microservices, and event-driven integration patterns.
- Practical experience with Kubernetes, OpenShift, and Google Cloud Platform, preferably Cloud Run, Dataproc, GKE, and BigQuery.
- Experience with CI/CD, automated testing, Git-based workflows, secure engineering, and production support for business-critical services.
- Ability to define technical direction, establish reusable standards, and influence decisions across organizational boundaries.
- Strong analytical, communication, and stakeholder-management skills, including the ability to connect engineering decisions to business value, risk, and total cost of ownership.
- Experience mentoring engineers and improving the technical capability, delivery discipline, and production ownership of wider teams.
- Experience in a regulated environment, preferably banking, financial services, Risk, Finance, Treasury, or regulatory reporting.
- Preferred experience includes GitHub Copilot, Gemini Code Assist or CLI, agentic AI applications, specification-driven development, Model Context Protocol, LangChain/LangGraph, Retrieval-Augmented Generation, Polars, Trino, Kafka, data lineage, metadata, data-quality frameworks, Site Reliability Engineering, or FinOps.
- Ability to use AI tools productively while applying critical judgment for responsible and ethical use of data and AI outputs.
Benefits
- Flexible benefits scheme with best-in-class leave policy.
- Gender-neutral parental leave and childcare assistance reimbursement.
- Sponsorship for industry-relevant certifications and education.
- Employee Assistance Program for employees and family members.
- Comprehensive hospitalization insurance for employees and dependents.
- Accident and term life insurance.
- Complementary health screening for employees aged 35 and above.
- Training, development, coaching, and ongoing support from team experts.
- Location is Pune, India.
Tech Stack
Apache KafkaApache SparkGitGoogle BigQueryGoogle Cloud PlatformJavaKubernetesOpenShiftSpring BootSQL
Categories
BackendData Engineering
About D.B. Group
D.B. Group is an Italian freight forwarder and logistics provider offering air, ocean, road, and rail transport, customs brokerage, and supply chain management for global shippers. Founded in 1980 and headquartered in Montebelluna, Veneto, it is privately held and operates through 79 subsidiaries with a worldwide partner network. The company delivers end-to-end forwarding and integrated logistics services, from consolidation and warehousing to door-to-door deliveries and trade compliance.