Staff Designated Support Engineer
Databricks
about 1 year ago
San Francisco, CA, USA
Staff+ / Senior
H1B Sponsor
Base Salary
$142k - $251k/yr
Responsibilities
- Perform advanced troubleshooting and root cause analysis for Spark and Databricks runtime features.
- Discover requirements for continuous monitoring to optimize customer environments.
- Build rapid proofs of concept and monitor solutions to address customer challenges.
- Develop playbooks and maintain a knowledge base for Spark, ML, and AI workflows.
- Train customer teams on performance tuning and best practices for Databricks features.
- Pilot new best practices and collaborate with teams to enhance customer experience.
- Advocate for customers in business review meetings and maintain trusted advisor relationships.
- Collaborate with Field Engineering, Sales, and Product teams during customer engagements.
Requirements
- 8–12 years of experience in designing and troubleshooting distributed computing applications.
- 4+ years of experience delivering production-scale Spark/ML/AI solutions using Python, Java, or Scala.
- Hands-on expertise with Data Lakes, SQL-based databases, and cloud-based ETL tools.
- Deep knowledge of Spark internals, Delta/Iceberg, and JVM optimization.
- Practical experience with AWS, Azure, or GCP and CI/CD pipeline management.
- 3–5 years in customer-facing roles demonstrating strong communication and problem-solving skills.
- Proven ability to anticipate and mitigate risks while planning solutions for production challenges.
- Ability to work with cross-functional teams and create impactful documentation.
Tech Stack
Amazon RedshiftApache SparkAWSAzureGoogle BigQueryGoogle Cloud PlatformJavaPythonScalaSnowflakeSQL
Categories
AI & MLData EngineeringData Science