22 days ago
Chicago, IL, USA +2 moreSenior
Base Salary
$102k - $179k/yr
Responsibilities
- Develop and enhance enterprise Databricks platform capabilities for analytics, data products, machine learning, and AI workloads.
- Implement platform architectures, engineering standards, reusable design patterns, and reference architectures.
- Build and maintain Infrastructure-as-Code solutions, CI/CD pipelines, automation frameworks, reusable templates, and deployment accelerators.
- Improve self-service platform adoption, developer experience, engineering productivity, and operational efficiency.
- Optimize platform scalability, performance, reliability, and cost efficiency across cloud environments.
- Collaborate with Enterprise Architecture, Cloud Engineering, Data Engineering, Product Management, and Data Science teams.
- Support Databricks services including MLflow, Model Registry, Feature Store, and Vector Search.
- Evaluate Databricks features and cloud technologies through technical assessments and proofs of concept.
- Recommend platform enhancements, automation opportunities, engineering best practices, and roadmap initiatives.
Requirements
- Five or more years of relevant experience.
- Two or more years of hands-on experience with the Databricks platform.
- Experience with Azure cloud services and cloud-native architectures preferred.
- Experience developing and maintaining Infrastructure-as-Code solutions using Terraform and CI/CD pipelines.
- Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architecture concepts.
- Experience developing automation solutions and reusable engineering components.
- Experience with MLflow, MLOps, AI platform technologies, streaming, or event-driven architectures preferred.
- Experience supporting enterprise-scale data platforms and healthcare or other regulated environments preferred.
- A relevant degree is preferred.
- Strong analytical, problem-solving, collaboration, and communication skills.
Benefits
- Comprehensive benefits plan.
- The position is incentive eligible.
- Geographic factors may adjust the estimated salary range.
- The estimated salary range is $102,400.00 to $179,000.00.
Tech Stack
Categories
Data EngineeringDevOps
