Solution Architect - Data Engineer
KSB SE & Co. KGaA5 months ago
Pune, IndiaSenior
Responsibilities
- Design and develop scalable data pipelines and a growing data lake.
- Build and extend data processing workflows using Python, Apache Spark, and Databricks.
- Define technical standards, best practices, and reusable data engineering frameworks.
- Ensure data quality, reliability, performance, and maintainability across data solutions.
- Support data modeling, data integration, and transformation for analytics and reporting.
- Drive automation, monitoring, and CI/CD improvements.
- Collaborate across engineering, analytics, data, and business teams as a technical interface.
- Contribute to architecture decisions and long-term data platform strategy.
- Deploy, monitor, and maintain data pipelines and services in production.
Requirements
- Strong programming experience, preferably in Python, with the ability to write clean, testable, production-grade code.
- Strong SQL skills and familiarity with JSON, Protobuf, and Delta format.
- Hands-on experience with Apache Spark, ideally on Databricks.
- Understanding of medallion architecture, data lakehouse principles, data modeling, and data governance.
- Experience building and maintaining CI/CD pipelines, such as GitLab CI.
- Familiarity with infrastructure as code and deployment practices.
- Experience with AWS or comparable cloud providers and familiarity with Databricks as a managed lakehouse platform.
- Experience with event-driven architectures or streaming platforms such as Kafka.
- Proven experience deploying, monitoring, and maintaining production data pipelines and services.
- Experience with testing practices, autonomous execution, end-to-end ownership, and cross-functional communication.
Tech Stack
Categories
Data Engineering
About KSB SE & Co. KGaA
KSB SE & Co. KGaA designs, manufactures, and services centrifugal pumps, valves, and related systems for industrial, water/wastewater, energy, mining, and building services customers. Founded in 1871 and headquartered in Frankenthal, Germany, the public company operates a global network of production and service sites, generating revenue from equipment sales, spare parts, and lifecycle services across diverse fluid-handling applications.