2 days ago
Base Salary
$100k - $140k/yr
Responsibilities
- Design, deploy, administer, and manage Databricks workspaces across development, test, UAT, and production environments.
- Manage clusters, cluster policies, instance pools, job clusters, runtime upgrades, performance, scalability, availability, and resource utilization.
- Integrate Databricks with AWS IAM and manage authentication, authorization, service principals, personal access tokens, secret scopes, SSO, and least-privilege access.
- Administer Unity Catalog, catalogs, schemas, tables, permissions, RBAC, governance policies, audit logging, and compliance requirements.
- Configure Git integration and support CI/CD and infrastructure automation for notebooks, workflows, and Databricks infrastructure using Terraform.
- Monitor platform health, jobs, clusters, logs, incidents, releases, and operational dashboards; perform troubleshooting and root cause analysis.
- Optimize Databricks and cloud spending through cluster sizing, auto-scaling, job scheduling, and compute-utilization strategies.
- Support critical and nonproduction databases and third-party application installation, configuration, integration, management, and monitoring in SOX- and PHI-compliant environments.
- Develop automated monitoring and proactive intervention procedures to prevent customer impact.
Requirements
- 8–10+ years of overall IT experience, including 5+ years of hands-on Databricks platform administration and management in production on AWS.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Hands-on experience with enterprise Databricks platforms, multiple workspaces, Unity Catalog, AWS IAM integration, cluster policies, runtime upgrades, CI/CD, Git integration, monitoring, troubleshooting, secrets management, audit logging, production support, and cost optimization.
- Strong AWS, cloud networking, security, scalability, high availability, DevOps, system design, architecture, Terraform, and CI/CD experience.
- Experience with AWS IAM, VPC concepts, EC2, S3, CloudWatch, KMS, security groups, Azure DevOps, GitHub Actions, or Jenkins.
- Preferred experience managing Databricks environments with 100+ users or supporting multiple business units and enterprise data platforms.
- Preferred knowledge of Lakehouse architecture, Delta Lake, FinOps practices, data governance, and security frameworks.
- Nice-to-have experience with AWS Organizations, Control Tower, PrivateLink, VPC endpoints, Datadog, Splunk, Apache Spark internals, and AI/ML workloads on Databricks.
- Preferred certifications include Databricks Certified Data Engineer Professional, Databricks Certified Platform Administrator, AWS Certified Solutions Architect, AWS Certified SysOps Administrator, and Terraform Associate.
Tech Stack
Categories
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).
