Data Engineer
Wissen Technology6 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable data pipelines with Azure Databricks, PySpark, and Azure Data Factory.
- Support the full data lifecycle from acquisition and cleansing through integration, analytics, and visualization.
- Build and optimize Delta Tables and Azure Data Lake solutions for enterprise data platforms.
- Develop automated data processing services, APIs, and analytics products.
- Implement data governance and security controls using Unity Catalog.
- Optimize data warehouse and analytics workloads with Azure Synapse Analytics.
- Perform code reviews, testing, monitoring, and troubleshooting to maintain data platform reliability.
- Collaborate with data architects, business stakeholders, and engineering teams to deliver data solutions.
- Mentor junior data engineers and promote engineering best practices.
- Drive end-to-end data platform initiatives independently.
Requirements
- 8–10 years of data engineering experience.
- At least 8 years building and optimizing large-scale data processing solutions with Azure Databricks.
- Experience with Azure Data Factory for enterprise ETL/ELT orchestration and workflow automation.
- Experience with PySpark, Azure Data Lake, Azure Synapse Analytics, Delta Tables, Delta Lake, Unity Catalog, Python, and SQL.
- BE in Computer Science, Engineering, Information Technology, or a related field.
- Experience mentoring junior data engineers and promoting engineering best practices.
- Strong analytical, troubleshooting, and problem-solving capabilities.
- Excellent written and verbal communication skills with cross-functional teams and stakeholders.
- Preferred experience with serverless compute architecture on Azure, data visualization and analytics product development, API development, Azure DevOps CI/CD, and data quality, monitoring, and observability frameworks.
Benefits
- Hybrid work arrangement in Bangalore.
About Wissen Technology
Wissen Technology is an IT services and consulting firm that builds custom software products, data platforms, and cloud/AI solutions for enterprises in finance, telecom, healthcare, retail, and manufacturing. It operates a services model spanning product engineering, application development, data engineering/analytics, and ERP integration, including Oracle Cloud. Founded in 2015 and headquartered in Bangalore, it is privately held with offices across India, the US, UK, UAE, and Australia.