Senior Data Engineer
OEConnection3 months ago
Chennai, IndiaSenior
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes across AWS and Azure.
- Develop database scripts, stored procedures, triggers, functions, SSIS packages, Azure Data Factory pipelines, AWS Glue jobs, and other backend integration processes.
- Own enterprise BI and reporting solutions, including metrics, reports, analyses, and dashboards.
- Implement user access controls, data security measures, secure secrets management, and data lake governance.
- Support tabular and multidimensional data modeling and maintain enterprise data warehouse solutions.
- Coordinate with management and end users to evaluate business needs and recommend cross-cloud analytics approaches.
- Develop and execute system and unit testing, identify and fix defects, and validate cross-cloud compatibility.
Requirements
- Bachelor’s degree from an accredited college or university in Information Technology, Computer Science, or a related discipline.
- 6–10 years of experience in data engineering and reporting.
- Strong experience developing and testing database scripts, stored procedures, triggers, functions, SSIS packages, AWS services, Azure services, and backend integration processes.
- Experience with BI, analytics, and statistical tools including Power BI, Tableau, SSRS, SSAS, and Excel.
- Strong SQL, business intelligence, AWS cloud services, and report development skills.
- Hands-on experience with Azure Data Factory, Azure SQL, Azure Blob Storage, Azure Dataflow, Logic Apps, Azure Synapse Analytics, Function Apps, and Key Vaults.
- Hands-on experience with AWS S3, Lambda, Glue, Step Functions, Redshift, Athena, SNS, SQS, EventBridge, Event Bus, SageMaker, IAM, Secrets Manager, Bedrock, CloudWatch, and Lake Formation.
- Understanding of configuration, deployment, and database servers.
- Strong written and verbal communication skills and ability to collaborate in a functional team environment.
- Automotive industry domain expertise and AWS or Azure certification are preferred.