Software Engineer – Data Platform
Continental5 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Design, implement, maintain, and operate secure, scalable, fault-tolerant, and observable data ingestion pipelines and inbound/outbound interfaces.
- Build Python- or Scala-based extraction services and integrate source systems including SAP, Salesforce, SharePoint, APIs, and file-based endpoints.
- Implement CDC, delta, event-based, push-based HTTP, and Kerberos-authenticated data transfer patterns.
- Develop reusable, version-controlled platform components, backend services, APIs, and data interfaces with monitoring, logging, alerting, and failure handling.
- Establish and maintain a web-accessible data catalog using Unity Catalog for metadata management, dataset discovery, previews, exploration, and lineage.
- Design structured access-request workflows with submissions, approval chains, audit trails, and enablement triggers.
- Define and implement multi-layered data quality frameworks, including validation rules, centralized rule storage, monitoring, severity levels, filtering, flagging, and quarantine logic.
- Collaborate with cybersecurity, infrastructure, architecture, IT, source-system owners, and business stakeholders on secure and sustainable delivery.
- Conduct design reviews, maintain interface documentation and compliance, and manage audit and traceability requirements.
- Serve as a technical escalation point for complex source integrations and contribute to a global data engineering team.
Requirements
- Degree in Computer Science, Data Engineering, or a related field.
- 5–8 years of software development experience with inbound and outbound data exchange interfaces, APIs, CDC, and endpoint management.
- Hands-on experience with Scala, Java, Python, advanced SQL, Git, and CI/CD development practices.
- Experience building robust ingestion pipelines and ETL jobs in a software engineering context.
- Experience with Scala and Azure Databricks is required.
- Experience with Azure or another hyperscaler resource-management environment.
- Familiarity with data lakes, data warehousing, Databricks, and Azure.
- Backend or distributed-systems experience and the ability to collaborate across global teams and enterprise stakeholders.
Benefits
- Training opportunities.
- Mobile and flexible working models.
- Sabbaticals.
- Full-time position with collaboration across geographies and time zones.
About Continental
Continental develops and manufactures tires, automotive electronics, software, and systems for vehicle safety, automated driving, and connectivity, serving global automakers and industrial customers. Its ContiTech division supplies rubber and plastic-based solutions such as belts, hoses, and materials for non-automotive applications. Founded in 1871 and headquartered in Hannover, Germany, Continental AG is a public company listed in Frankfurt and operates worldwide across OEM and aftermarket channels.