Senior Designated Support Engineer
Databricks2 months ago
Sydney, AustraliaSenior
Responsibilities
- Perform advanced troubleshooting and root cause analysis for performance and reliability issues involving Spark, SQL, Delta, streaming, and Databricks runtime features.
- Design monitoring requirements and collaborate with R&D and NOC teams to optimize customer environments.
- Build rapid proofs of concept and test, deploy, and monitor solutions developed by Databricks Engineering.
- Develop playbooks and maintain a knowledge base covering Spark, ML, and AI workflows.
- Train customer engineering and business teams on performance tuning, debugging, and Databricks features.
- Pilot best-practice programs, champion process improvements, and collaborate cross-functionally to improve customer experience.
- Serve as a trusted advisor and primary technical point of contact, advocating for customers in business reviews.
- Collaborate with Field Engineering, Sales, and Product teams during customer engagements and technical presentations to resolve production-impacting issues.
Requirements
- 5–8 years of experience designing, building, and troubleshooting distributed-computing applications.
- At least 4 years of experience delivering production-scale Spark, ML, or AI solutions using Python, Java, or Scala.
- Hands-on expertise with data lakes, SQL-based databases, and cloud data warehousing or ETL tools such as Snowflake, Redshift, and BigQuery.
- Deep knowledge of Spark internals, Delta or Iceberg, JVM optimization, and memory management.
- Proficiency with machine learning, deep learning, and generative AI ecosystems.
- Practical experience with AWS, Azure, or GCP and with CI/CD pipelines, monitoring, and alerting systems.
- 3–5 years of customer-facing experience in roles such as Technical Account Manager or Solutions Architect.
- Ability to anticipate and mitigate risks, coordinate technical resources, collaborate with senior leadership, and create self-service documentation.
Benefits
- Databricks offers comprehensive benefits and perks, with details varying by region.
- The role includes collaboration onsite during customer engagements and technical presentations when required.
Tech Stack
Amazon RedshiftApache SparkAWSAzureDatabricksGoogle BigQueryGoogle Cloud PlatformJavaPythonScalaSnowflakeSQL
Categories
Data EngineeringSolutions Engineering
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.