Senior Staff Backline Engineer - Data & AI
Databricks2 months ago
Base Salary
$170.4 - $255.6/yr
Responsibilities
- Conduct deep-dive forensic troubleshooting of Spark core internals and the Databricks Data and AI ecosystem.
- Perform code-level root-cause analysis and resource profiling to resolve systemic production issues.
- Optimize architecture, execution parameters, and best-practice strategies for performance, scalability, and resource efficiency.
- Analyze issue trends and partner with Product Engineering to influence the roadmap and improve product supportability.
- Build reproduction frameworks, automated workflows, and AI-driven diagnostic tools to standardize resolution paths.
- Manage customer relationships and technical stakeholders during complex escalations.
Requirements
- 10+ years of relevant experience.
- Deep expertise in one specialized track: large-scale data engineering, distributed-system product supportability, or large-scale machine learning and generative AI systems.
- Data Engineering candidates should have experience with Spark, Delta Lake, or Hive; troubleshooting data failures and performance issues; and hands-on programming in Python, SQL, or Scala.
- Product Supportability candidates should understand distributed-system internals, perform code-level root-cause analysis and profiling using metrics and heap/thread dumps, contribute to bug fixes, and mentor engineers.
- AI candidates should understand model training, evaluation, deployment, ML lifecycle governance and operationalization, LLM-based applications, agent-driven workflows, and distributed ML workload optimization.
- Proven experience managing customers and technical stakeholders.
Benefits
- Comprehensive employee benefits and perks, with details varying by region.
- The total compensation package may include an annual performance bonus and equity.
Tech Stack
Categories
Data Engineering
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.