Data Platforms Senior Engineer – Databricks
Waters Corporation2 months ago
India (city not specified)Mid Level / Senior
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
- Develop and optimize data processing solutions using Databricks and Apache Spark.
- Build data pipelines with PySpark, Python, and SQL.
- Work with Databricks notebooks, workflows/jobs, clusters, and Delta Lake.
- Implement incremental data processing and performance optimization techniques.
- Manage source code in GitHub, including branching, pull requests, code reviews, and repository management.
- Implement and maintain CI/CD pipelines for data engineering workloads using GitHub-based development practices.
- Interpret customer business needs and translate them into operational requirements.
Requirements
- Bachelor’s degree in computer science, software engineering, information systems, or a related field.
- Typically 4–7 years of relevant experience in data engineering, ETL, data warehousing, or data analytics decision support.
- Strong hands-on experience with the Databricks platform.
- Expert proficiency in SQL and Python, including advanced querying, stored procedures, and performance tuning.
- Extensive experience with ETL tools and platforms such as SSIS, Azure Data Factory, and Azure Databricks.
- Deep understanding of data warehousing concepts, dimensional modeling, and Kimball/Inmon methodologies.
- Familiarity with big data technologies such as Spark, Hadoop, and Kafka.
- Experience with version control systems such as Git.
- Strong technical and analytical skills and the ability to understand customer business needs.
Tech Stack
Categories
Data Engineering
About Waters Corporation
Waters Corporation builds analytical instruments and software for pharmaceutical, biopharma, food and environmental labs, and clinical diagnostics. Its portfolio spans UPLC/HPLC chromatography, mass spectrometry, thermal analysis (TA Instruments), informatics, and analytical standards and reagents, sold alongside service and consumables. Founded in 1958 and headquartered in Milford, Massachusetts, Waters is a public company (NYSE: WAT) with systems used in drug development, quality control, and safety testing worldwide.