Databricks

Staff Designated Support Engineer

Databricks
Apply
3 months ago
Sydney, AustraliaStaff+

Responsibilities

  • Perform advanced troubleshooting and root-cause analysis for Spark, SQL, Delta, streaming, and Databricks runtime performance and reliability issues.
  • Use Spark UI metrics, DAGs, event logs, and related tools to diagnose and resolve complex customer problems.
  • Identify continuous-monitoring requirements and collaborate with R&D and NOC teams to optimize customer environments.
  • Build rapid proofs of concept and test, deploy, and monitor solutions developed by Databricks Engineering.
  • Develop playbooks and maintain knowledge bases covering Spark, ML, and AI workflows.
  • Train customer engineering and business teams on performance tuning, debugging, and Databricks best practices.
  • Pilot process improvements, collaborate cross-functionally, and advocate for customers in business reviews.
  • Partner with Field Engineering, Sales, Product, and customers during technical engagements and presentations, including onsite work.

Requirements

  • 10+ years of experience designing, building, and troubleshooting distributed computing applications.
  • 4+ years delivering production-scale Spark, ML, or AI solutions using Python, Java, or Scala.
  • Hands-on data engineering expertise with data lakes, SQL-based databases, and cloud data warehousing or ETL tools such as Snowflake, Redshift, and BigQuery.
  • Deep knowledge of Spark internals, Delta or Iceberg, JVM optimization, memory management, machine learning, deep learning, and generative AI.
  • Practical experience with AWS, Azure, or GCP and with building and managing CI/CD pipelines, monitoring, and alerting systems.
  • 3–5 years of customer-facing experience in roles such as Technical Account Manager or Solutions Architect.
  • Ability to proactively identify and mitigate production risks, coordinate technical resources, and exercise sound business judgment.
  • Ability to collaborate with cross-functional teams and senior leadership while creating effective technical documentation.
  • Strong communication, relationship-building, problem-solving, and customer-success skills.

Benefits

  • Databricks offers comprehensive benefits and perks, with specific details varying by region.

Tech Stack

Amazon RedshiftApache SparkAWSAzureDatabricksGoogle BigQueryGoogle Cloud PlatformJavaPythonScalaSnowflakeSQL

Categories

Solutions Engineering
Databricks

About Databricks

10,000+ employees

Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.

Contact me