Azure Data Engineer - CTR
Datavail, LLC21 days ago
Mumbai, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable ETL/ELT solutions and data pipelines.
- Support and enhance enterprise data warehouse solutions and dimensional data models.
- Analyze legacy SSIS packages and lead modernization efforts toward Azure Data Factory and cloud-based architectures.
- Build and optimize data ingestion, transformation, integration, REST API, third-party, SFTP, and file-based processes.
- Perform advanced SQL development, query optimization, and performance tuning for large-volume datasets.
- Troubleshoot production issues, conduct root-cause analysis, and implement preventive solutions.
- Ensure data quality through reconciliation, validation, monitoring, exception handling, and quality controls.
- Collaborate with technical and business stakeholders to gather requirements and build data solutions.
- Implement CI/CD pipelines, source control practices, and deployment automation for data engineering solutions.
- Support hybrid on-premises and cloud environments and participate in architecture and modernization discussions.
Requirements
- Bachelor’s degree.
- At least 8 years of experience in data engineering, ETL development, or data warehousing.
- Strong expertise in Microsoft SQL Server and advanced T-SQL development.
- Strong hands-on experience with Azure Data Factory and extensive experience designing and building ETL/ELT pipelines.
- Strong experience developing, troubleshooting, migrating, and modernizing SSIS workloads.
- Knowledge of data warehousing, dimensional modeling, fact and dimension models, star schemas, and snowflake schemas.
- Experience with large-volume data processing, SQL performance tuning, REST APIs, external data providers, SFTP, and file-based integrations.
- Experience with data validation, reconciliation, quality controls, production support, and troubleshooting.
- Experience with Git, source control, CI/CD, and deployment automation.
- Experience across on-premises, hybrid, and cloud data platforms.
- Preferred experience with AI-enabled data engineering, Azure OpenAI Service, OpenAI API integrations, Python AI automation, anomaly detection, RAG, embeddings, and vector databases.
- Additional preferred skills include Python, PySpark, Databricks, Snowflake, Azure Synapse Analytics, Microsoft Fabric, MongoDB or NoSQL databases, PowerShell, and data lake or lakehouse architectures.
- Ability to work independently, troubleshoot complex legacy and modern platforms, support mission-critical production environments, communicate with technical and business stakeholders, and take ownership of deliverables.
Benefits
- Remote position based in India.
- Requires overlap with North American business hours until approximately 3:00–4:00 PM Eastern Time, with possible staggered shifts for broader coverage and operational continuity.
Categories
Data Engineering
About Datavail, LLC
Datavail is an IT services consultancy and managed services provider that helps enterprises run and modernize data platforms, analytics, cloud, and enterprise applications. It delivers database administration and data management across Oracle, Microsoft SQL Server, MySQL, and MongoDB, plus BI/DW, analytics, and application managed services. Founded in 2007 and headquartered in Boulder, Colorado, the company is privately held and backed by private-equity owner CIVC Partners.