Staff Designated Support Engineer
Databricks2 months ago
Sydney, AustraliaStaff+
Responsibilities
- Perform advanced troubleshooting and root-cause analysis for performance and reliability issues involving Spark, SQL, Delta, streaming, and Databricks runtime features.
- Identify continuous-monitoring requirements and work with R&D and NOC teams to optimize customer environments.
- Build rapid proofs of concept and test, deploy, and monitor solutions developed by Databricks Engineering.
- Create playbooks and maintain a knowledge base for Spark, ML, and AI workflow issues and solutions.
- Train customer engineering and business teams on performance tuning, debugging, and Databricks best practices.
- Pilot process improvements, collaborate cross-functionally, and advocate for customers in business reviews.
- Act as a trusted advisor and primary technical point of contact during customer engagements and technical presentations.
Requirements
- 10+ years of experience designing, building, and troubleshooting distributed computing applications.
- 4+ years delivering production-scale Spark, ML, or AI solutions using Python, Java, or Scala.
- Hands-on expertise with data lakes, SQL-based databases, and cloud data warehousing or ETL tools such as Snowflake, Redshift, and BigQuery.
- Deep knowledge of Spark core internals, Delta or Iceberg, JVM optimization, and memory management.
- Proficiency with machine learning, deep learning, and generative AI ecosystems.
- Practical experience with AWS, Azure, or GCP and building or managing CI/CD pipelines, monitoring, and alerting systems.
- 3–5 years of customer-facing experience in roles such as Technical Account Manager or Solutions Architect.
- Strong proactive problem-solving, risk management, cross-functional collaboration, leadership, communication, and technical documentation skills.
Benefits
- Databricks offers comprehensive employee benefits and perks, with details varying by region.
- The role involves onsite collaboration with customers and Field Engineering during engagements, as stated in the posting.
Tech Stack
Amazon RedshiftApache SparkAWSAzureDatabricksGoogle BigQueryGoogle Cloud PlatformJavaPythonScalaSnowflakeSQL
Categories
Solutions Engineering
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.