Principal Azure Databricks Platform Engineer
Syneos Health2 days ago
Hyderābād, IndiaStaff+
Responsibilities
- Design, implement, administer, troubleshoot, and optimize enterprise Azure Databricks environments across development, staging, and production.
- Manage Databricks account and workspace configurations, identity, permissions, networking, compute policies, SQL warehouses, serverless capabilities, workload isolation, monitoring, audit logging, and cost observability.
- Build reusable infrastructure-as-code modules, deployment templates, CI/CD pipelines, and automated provisioning using the Databricks Terraform Provider and Azure Terraform Provider.
- Automate Databricks administration and deployments using Declarative Automation Bundles, Databricks CLI, REST APIs, Python, PowerShell, Bash, and Git-based practices.
- Lead Unity Catalog administration, data access models, governance policies, auditing, lineage, data discovery, secure sharing, and integration with enterprise governance tools.
- Design and operate Azure networking, private endpoints, VNets, DNS, storage, identity, security, high availability, backup, disaster recovery, monitoring, and cost optimization for Databricks environments.
- Evaluate and operationalize emerging Databricks capabilities including Unity Gateway or AI Gateway, Lakebase, Lakeflow, Delta Sharing, Databricks Apps, and AI platform services.
- Establish platform standards, reference architectures, onboarding patterns, operational runbooks, and reusable components.
- Lead technical initiatives, mentor engineers, conduct design reviews, provide technical direction, and collaborate with cloud, security, networking, operations, data engineering, and business teams.
Requirements
- 8+ years of relevant experience in cloud engineering, platform engineering, infrastructure automation, or enterprise data platform technologies.
- Strong hands-on experience with Microsoft Azure infrastructure architecture, networking, storage, identity, and security.
- Significant hands-on production experience administering and engineering Azure Databricks platforms, preferably 4+ years.
- Advanced experience with Databricks administration, account and workspace configuration, compute governance, operational troubleshooting, performance optimization, and Unity Catalog.
- Strong Terraform experience, including reusable modules, state management, environment configuration, and Databricks-specific resources.
- Experience with Databricks Declarative Automation Bundles or Asset Bundles, Databricks CLI, APIs, CI/CD, GitHub Actions, Azure DevOps, or similar deployment tools.
- Proficiency with Python, PowerShell, or Bash for scripting and automation.
- Strong knowledge of Azure networking, private endpoints, DNS, ADLS Gen2, Key Vault, Entra ID, monitoring, logging, infrastructure governance, and disaster recovery.
- Experience leading complex technical initiatives, mentoring engineers, making architectural decisions, and establishing platform engineering standards.
- Preferred experience with Unity Gateway or AI Gateway, Lakebase, Lakeflow, Delta Sharing, Databricks Apps, AI platform services, system tables, audit logs, observability, FinOps, multi-tenant or data-mesh platforms, Azure Data Factory, and relevant Databricks, Terraform, or Microsoft Azure certifications.
- Equivalent experience, skills, and/or education will also be considered.
Benefits
- Career development and progression opportunities.
- Supportive and engaged line management, technical and therapeutic area training, peer recognition, and a total rewards program.
- Inclusive culture and reasonable accommodations in accordance with the Americans with Disabilities Act.
Categories
Data EngineeringDevOps
About Syneos Health
Syneos Health provides outsourced clinical development and commercialization services to pharmaceutical and biotech companies, spanning clinical trials, medical affairs, and product launch support. The company operates under fee-for-service and functional service provider models across global drug development. Headquartered in Morrisville, NC, it was formed in 2017 through the merger of INC Research and inVentiv Health and was acquired in 2023 by affiliates of Elliott Management.