Staff Engineer, Databricks Platform
Modernizing Medicine, Inc.3 days ago
Boca Raton, FL, USAStaff+
Responsibilities
- Own Databricks account-, workspace-, Unity Catalog-, compute-, and access-management capabilities across development, test, and production environments.
- Automate Databricks provisioning and configuration, including identity federation, SSO/SCIM, service principals, workspace assignments, entitlements, administrative controls, and compute policies.
- Build and maintain reusable Terraform modules and CI/CD workflows using the Databricks and AWS providers, including testing, approvals, promotion, rollback, and drift remediation.
- Implement secure AWS integrations covering networking, private connectivity, IAM, S3, KMS, DNS, secrets management, Aurora, and Kafka.
- Establish controls for PHI and other sensitive data, including encryption, network isolation, privileged access, auditability, access reviews, and break-glass procedures.
- Define platform service levels, observability, alerts, dashboards, runbooks, incident-response practices, recovery patterns, cost attribution, budgets, forecasting, and optimization.
- Build paved-road templates, documentation, and self-service capabilities for Data Engineering, Analytics, ML Engineering, AI Engineering, and MLOps teams.
- Configure shared MLflow and Models in Unity Catalog capabilities and support approved training, inference, and model-serving patterns.
- Lead a shared on-call and escalation rotation, complex incident diagnosis, root-cause analysis, production change management, and preventive actions.
Requirements
- Demonstrated production ownership of Databricks on AWS in a multi-team environment, including account- and workspace-level administration.
- Strong experience with Unity Catalog, identity federation, service principals, compute policies, secure data-access patterns, lineage, and auditability.
- Deep production experience with Terraform and infrastructure-as-code practices, including modular infrastructure, state management, source control, automated testing, and CI/CD.
- Strong AWS knowledge across IAM, VPC networking, private connectivity, S3, KMS, security groups, logging, and cross-account access.
- Experience operating cloud data platforms containing regulated, confidential, or highly sensitive data.
- Experience with observability, incident response, change management, capacity planning, and cloud cost optimization.
- Experience leading a significant platform migration, workspace or metastore consolidation, runtime upgrade, or comparable production modernization.
- Working knowledge of Spark and distributed computing for diagnosing platform and workload-performance issues.
- Proficiency in Python for automation, plus practical shell scripting and REST API integration.
- Strong communication and influence skills, with success establishing standards and self-service guardrails across organizational boundaries.
- Preferred qualifications include healthcare data-platform experience and HIPAA-aligned PHI controls.
- Preferred experience includes MLflow, Models in Unity Catalog, model serving, GPU workloads, feature engineering platforms, GenAI infrastructure, multi-workspace or multi-region architectures, and disaster-recovery testing.
- Databricks and/or AWS professional certification is valuable but does not replace production platform ownership.
Benefits
- Comprehensive medical, dental, and vision benefits with a company Health Savings Account contribution.
- 401(k) matching contribution of 50% on employee contributions up to 6% of compensation, with matching contributions fully vested after one year.
- Generous paid time off, paid parental leave, company-paid life and disability benefits, flexible spending accounts, and employee assistance programs.
- Professional development opportunities including tuition reimbursement and unlimited LinkedIn Learning access.
- Business Resource and Special Interest Groups, global collaboration opportunities, and in-person collaboration options.
- Hybrid office-based roles and remote availability for some roles; the company has a dog-friendly Boca Raton headquarters with catered meals and wellness amenities.
Tech Stack
Categories
About Modernizing Medicine, Inc.
Modernizing Medicine (ModMed) builds a specialty-specific, cloud-based platform for medical practices that integrates electronic health records, practice management, revenue cycle management, analytics, and patient engagement tools. The company sells its software and services on a subscription and services basis to outpatient specialties such as dermatology, ophthalmology, orthopedics, and gastroenterology. Founded in 2010 and headquartered in Boca Raton, Florida, ModMed is privately held and backed by Clearlake Capital Group.