Databricks

Staff Designated Support Engineer

Databricks

Apply
about 1 year ago
San Francisco, CA, USA
Staff+ / Senior
H1B Sponsor

Base Salary

$142k - $251k/yr

Responsibilities

  • Perform advanced troubleshooting and root cause analysis for Spark and Databricks runtime features.
  • Discover requirements for continuous monitoring to optimize customer environments.
  • Build rapid proofs of concept and monitor solutions to address customer challenges.
  • Develop playbooks and maintain a knowledge base for Spark, ML, and AI workflows.
  • Train customer teams on performance tuning and best practices for Databricks features.
  • Pilot new best practices and collaborate with teams to enhance customer experience.
  • Advocate for customers in business review meetings and maintain trusted advisor relationships.
  • Collaborate with Field Engineering, Sales, and Product teams during customer engagements.

Requirements

  • 8–12 years of experience in designing and troubleshooting distributed computing applications.
  • 4+ years of experience delivering production-scale Spark/ML/AI solutions using Python, Java, or Scala.
  • Hands-on expertise with Data Lakes, SQL-based databases, and cloud-based ETL tools.
  • Deep knowledge of Spark internals, Delta/Iceberg, and JVM optimization.
  • Practical experience with AWS, Azure, or GCP and CI/CD pipeline management.
  • 3–5 years in customer-facing roles demonstrating strong communication and problem-solving skills.
  • Proven ability to anticipate and mitigate risks while planning solutions for production challenges.
  • Ability to work with cross-functional teams and create impactful documentation.

Tech Stack

Amazon RedshiftApache SparkAWSAzureGoogle BigQueryGoogle Cloud PlatformJavaPythonScalaSnowflakeSQL

Categories

AI & MLData EngineeringData Science