25 days ago
Base Salary
$180k - $270k/yr
Responsibilities
- Own monitoring, alerting, observability, incident response support, and production runbooks for Databricks data jobs and platform services.
- Define CI/CD, deployment, and environment-promotion standards for Databricks assets, workflows, jobs, notebooks, code packages, and infrastructure configuration.
- Design platform standards for job orchestration, compute policies, service principals, environment isolation, and reliable production execution.
- Create reusable operational templates and enablement patterns for onboarding domains to Databricks.
- Partner with data engineering and cloud/infrastructure teams on observable, recoverable, secure, and compliant platform implementations.
- Track job success rates, incident trends, pipeline reliability, cost efficiency, and environment drift.
- Document platform standards and support models and mentor engineers developing Databricks platform expertise.
Requirements
- 12+ years of relevant experience in data platform engineering, platform operations, site reliability engineering, or modern cloud data infrastructure.
- Hands-on production experience with Databricks or a closely related cloud data platform.
- Experience designing or operating deployment automation, environment promotion, version control, and CI/CD for data platforms and pipelines.
- Strong understanding of observability, monitoring, alerting, incident management, and reliability engineering.
- Experience with compute policies, workload isolation, service principals, and secure production execution on cloud data platforms.
- Experience working in regulated or security-sensitive environments with access control, auditability, and operational discipline requirements.
- Ability to collaborate with cloud/infrastructure, security, data engineering, and analytics stakeholders.
- Preferred qualifications include Databricks certification or expertise with Delta Lake, Unity Catalog, Workflows, and Databricks Asset Bundles; infrastructure-as-code and enterprise platform automation experience; and experience with commercial, government, defense, aerospace, or other regulated environments.
Benefits
- Full-time regular employee package includes bonus, benefits, and equity in addition to pay within the listed range.
- Temporary employees receive a temporary benefits package applicable after 60 days of employment.
- Offers are contingent on a cleared background and possible reference check.
Tech Stack
Databricks
Categories
About Shield AI
Founded in 2015, Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide.